MFEM  v4.2.0
Finite element discretization library
 All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Pages
Classes | Public Types | Public Member Functions | Protected Types | Protected Member Functions | Static Protected Member Functions | Protected Attributes | Friends | List of all members
mfem::ParNCMesh Class Reference

A parallel extension of the NCMesh class. More...

#include <pncmesh.hpp>

Inheritance diagram for mfem::ParNCMesh:
[legend]
Collaboration diagram for mfem::ParNCMesh:
[legend]

Classes

class  ElementSet
 
class  ElementValueMessage
 
class  NeighborDerefinementMessage
 
class  NeighborElementRankMessage
 
class  NeighborRefinementMessage
 
class  RebalanceDofMessage
 
class  RebalanceMessage
 

Public Types

typedef short GroupId
 
typedef std::vector< int > CommGroup
 
- Public Types inherited from mfem::NCMesh
typedef int64_t RefCoord
 

Public Member Functions

 ParNCMesh (MPI_Comm comm, const NCMesh &ncmesh, int *part=NULL)
 
 ParNCMesh (const ParNCMesh &other)
 
virtual ~ParNCMesh ()
 
virtual void Refine (const Array< Refinement > &refinements)
 
virtual void LimitNCLevel (int max_nc_level)
 Parallel version of NCMesh::LimitNCLevel. More...
 
virtual void CheckDerefinementNCLevel (const Table &deref_table, Array< int > &level_ok, int max_nc_level)
 
virtual void Derefine (const Array< int > &derefs)
 
void Rebalance (const Array< int > *custom_partition=NULL)
 
int GetNElements () const
 
int GetNGhostVertices () const
 
int GetNGhostEdges () const
 
int GetNGhostFaces () const
 
int GetNGhostElements () const
 
const NCListGetSharedVertices ()
 
const NCListGetSharedEdges ()
 
const NCListGetSharedFaces ()
 
const NCListGetSharedList (int entity)
 Helper to get shared vertices/edges/faces ('entity' == 0/1/2 resp.). More...
 
int GetFaceOrientation (int index) const
 Return (shared) face orientation relative to its owner element. More...
 
GroupId GetEntityOwnerId (int entity, int index)
 Return vertex/edge/face ('entity' == 0/1/2, resp.) owner. More...
 
GroupId GetEntityGroupId (int entity, int index)
 
const CommGroupGetGroup (GroupId id) const
 Return a list of ranks contained in the group of the given ID. More...
 
bool GroupContains (GroupId id, int rank) const
 Return true if group 'id' contains the given rank. More...
 
bool IsGhost (int entity, int index) const
 Return true if the specified vertex/edge/face is a ghost. More...
 
int ElementRank (int index) const
 
int GetMyRank () const
 
void SendRebalanceDofs (int old_ndofs, const Table &old_element_dofs, long old_global_offset, FiniteElementSpace *space)
 Use the communication pattern from last Rebalance() to send element DOFs. More...
 
void RecvRebalanceDofs (Array< int > &elements, Array< long > &dofs)
 Receive element DOFs sent by SendRebalanceDofs(). More...
 
const Array< int > & GetRebalanceOldIndex () const
 
const Array< int > & GetDerefineOldRanks () const
 
template<typename Type >
void SynchronizeDerefinementData (Array< Type > &elem_data, const Table &deref_table)
 
virtual void GetBoundaryClosure (const Array< int > &bdr_attr_is_ess, Array< int > &bdr_vertices, Array< int > &bdr_edges)
 
virtual void Trim ()
 Save memory by releasing all non-essential and cached data. More...
 
long MemoryUsage (bool with_base=true) const
 Return total number of bytes allocated. More...
 
int PrintMemoryDetail (bool with_base=true) const
 
void GetDebugMesh (Mesh &debug_mesh) const
 
- Public Member Functions inherited from mfem::NCMesh
 NCMesh (const Mesh *mesh, std::istream *vertex_parents=NULL)
 
 NCMesh (const NCMesh &other)
 
virtual ~NCMesh ()
 
int Dimension () const
 
int SpaceDimension () const
 
int GetNVertices () const
 
int GetNEdges () const
 
int GetNFaces () const
 
const TableGetDerefinementTable ()
 
const NCListGetFaceList ()
 Return the current list of conforming and nonconforming faces. More...
 
const NCListGetEdgeList ()
 Return the current list of conforming and nonconforming edges. More...
 
const NCListGetVertexList ()
 
const NCListGetNCList (int entity)
 Return vertex/edge/face list (entity = 0/1/2, respectively). More...
 
void MarkCoarseLevel ()
 
const CoarseFineTransformationsGetRefinementTransforms ()
 
const CoarseFineTransformationsGetDerefinementTransforms ()
 
void ClearTransforms ()
 Free all internal data created by the above three functions. More...
 
void GetEdgeVertices (const MeshId &edge_id, int vert_index[2], bool oriented=true) const
 Return Mesh vertex indices of an edge identified by 'edge_id'. More...
 
int GetEdgeNCOrientation (const MeshId &edge_id) const
 
int GetFaceVerticesEdges (const MeshId &face_id, int vert_index[4], int edge_index[4], int edge_orientation[4]) const
 
int GetEdgeMaster (int v1, int v2) const
 
Geometry::Type GetElementGeometry (int index) const
 Return element geometry type. index is the Mesh element number. More...
 
Geometry::Type GetFaceGeometry (int index) const
 Return face geometry type. index is the Mesh face number. More...
 
int GetNumRootElements ()
 Return the number of root elements. More...
 
int GetElementDepth (int i) const
 Return the distance of leaf 'i' from the root. More...
 
int GetElementSizeReduction (int i) const
 
void GetElementFacesAttributes (int i, Array< int > &faces, Array< int > &fattr) const
 Return the faces and face attributes of leaf element 'i'. More...
 
void PrintVertexParents (std::ostream &out) const
 I/O: Print the "vertex_parents" section of the mesh file (ver. >= 1.1). More...
 
void PrintCoarseElements (std::ostream &out) const
 I/O: Print the "coarse_elements" section of the mesh file (ver. >= 1.1). More...
 
void LoadVertexParents (std::istream &input)
 
void LoadCoarseElements (std::istream &input)
 I/O: Load the element refinement hierarchy from a mesh file. More...
 
void SetVertexPositions (const Array< mfem::Vertex > &vertices)
 I/O: Set positions of all vertices (used by mesh loader). More...
 
long MemoryUsage () const
 Return total number of bytes allocated. More...
 
int PrintMemoryDetail () const
 
void PrintStats (std::ostream &out=mfem::out) const
 
void DebugLeafOrder (std::ostream &out) const
 
void DebugDump (std::ostream &out) const
 

Protected Types

typedef std::vector< CommGroupGroupList
 
typedef std::map< CommGroup,
GroupId
GroupMap
 
- Protected Types inherited from mfem::NCMesh
typedef HashTable< Node >::iterator node_iterator
 
typedef HashTable< Face >::iterator face_iterator
 
typedef HashTable< Node >
::const_iterator 
node_const_iterator
 
typedef HashTable< Face >
::const_iterator 
face_const_iterator
 
typedef BlockArray< Element >
::iterator 
elem_iterator
 
typedef std::map< std::string,
int > 
RefPathMap
 

Protected Member Functions

void GetConformingSharedStructures (class ParMesh &pmesh)
 
void GetFaceNeighbors (class ParMesh &pmesh)
 
virtual void Update ()
 
virtual bool IsGhost (const Element &el) const
 
virtual int GetNumGhostElements () const
 
virtual int GetNumGhostVertices () const
 
int Partition (long index, long total_elements) const
 Return the processor number for a global element number. More...
 
int InitialPartition (int index) const
 Helper to get the partitioning when the serial mesh gets split initially. More...
 
long PartitionFirstIndex (int rank, long total_elements) const
 Return the global index of the first element owned by processor 'rank'. More...
 
virtual void UpdateVertices ()
 update Vertex::index and vertex_nodeId More...
 
virtual void AssignLeafIndices ()
 
virtual void OnMeshUpdated (Mesh *mesh)
 
virtual void BuildFaceList ()
 
virtual void BuildEdgeList ()
 
virtual void BuildVertexList ()
 
virtual void ElementSharesFace (int elem, int local, int face)
 
virtual void ElementSharesEdge (int elem, int local, int enode)
 
virtual void ElementSharesVertex (int elem, int local, int vnode)
 
GroupId GetGroupId (const CommGroup &group)
 
GroupId GetSingletonGroup (int rank)
 
void InitOwners (int num, Array< GroupId > &entity_owner)
 
void MakeSharedList (const NCList &list, NCList &shared)
 
void AddConnections (int entity, int index, const Array< int > &ranks)
 
void CalculatePMatrixGroups ()
 
void CreateGroups (int nentities, Array< Connection > &index_rank, Array< GroupId > &entity_group)
 
void CalcFaceOrientations ()
 
void UpdateLayers ()
 
void MakeSharedTable (int ngroups, int ent, Array< int > &shared_local, Table &group_shared, Array< char > *entity_geom=NULL, char geom=0)
 
void AdjustMeshIds (Array< MeshId > ids[], int rank)
 
void ChangeVertexMeshIdElement (NCMesh::MeshId &id, int elem)
 
void ChangeEdgeMeshIdElement (NCMesh::MeshId &id, int elem)
 
void ChangeRemainingMeshIds (Array< MeshId > &ids, int pos, const Array< Pair< int, int > > &find)
 
void EncodeMeshIds (std::ostream &os, Array< MeshId > ids[])
 
void DecodeMeshIds (std::istream &is, Array< MeshId > ids[])
 
void EncodeGroups (std::ostream &os, const Array< GroupId > &ids)
 
void DecodeGroups (std::istream &is, Array< GroupId > &ids)
 
bool CheckElementType (int elem, int type)
 
void ElementNeighborProcessors (int elem, Array< int > &ranks)
 
void NeighborProcessors (Array< int > &neighbors)
 
void Prune ()
 
bool PruneTree (int elem)
 Internal. Recursive part of Prune(). More...
 
void RedistributeElements (Array< int > &new_ranks, int target_elements, bool record_comm)
 
void ClearAuxPM ()
 
long GroupsMemoryUsage () const
 
- Protected Member Functions inherited from mfem::NCMesh
void GetMeshComponents (Mesh &mesh) const
 Fill Mesh::{vertices,elements,boundary} for the current finest level. More...
 
void CollectLeafElements (int elem, int state)
 
void UpdateLeafElements ()
 
void InitRootState (int root_count)
 
void InitGeomFlags ()
 
bool HavePrisms () const
 
bool HaveTets () const
 
void RefineElement (int elem, char ref_type)
 
void DerefineElement (int elem)
 
int AddElement (const Element &el)
 
void FreeElement (int id)
 
int NewHexahedron (int n0, int n1, int n2, int n3, int n4, int n5, int n6, int n7, int attr, int fattr0, int fattr1, int fattr2, int fattr3, int fattr4, int fattr5)
 
int NewWedge (int n0, int n1, int n2, int n3, int n4, int n5, int attr, int fattr0, int fattr1, int fattr2, int fattr3, int fattr4)
 
int NewTetrahedron (int n0, int n1, int n2, int n3, int attr, int fattr0, int fattr1, int fattr2, int fattr3)
 
int NewQuadrilateral (int n0, int n1, int n2, int n3, int attr, int eattr0, int eattr1, int eattr2, int eattr3)
 
int NewTriangle (int n0, int n1, int n2, int attr, int eattr0, int eattr1, int eattr2)
 
mfem::ElementNewMeshElement (int geom) const
 
int QuadFaceSplitType (int v1, int v2, int v3, int v4, int mid[5]=NULL) const
 
bool TriFaceSplit (int v1, int v2, int v3, int mid[3]=NULL) const
 
void ForceRefinement (int vn1, int vn2, int vn3, int vn4)
 
void FindEdgeElements (int vn1, int vn2, int vn3, int vn4, Array< MeshId > &prisms) const
 
void CheckAnisoPrism (int vn1, int vn2, int vn3, int vn4, const Refinement *refs, int nref)
 
void CheckAnisoFace (int vn1, int vn2, int vn3, int vn4, int mid12, int mid34, int level=0)
 
void CheckIsoFace (int vn1, int vn2, int vn3, int vn4, int en1, int en2, int en3, int en4, int midf)
 
void ReparentNode (int node, int new_p1, int new_p2)
 
int FindMidEdgeNode (int node1, int node2) const
 
int GetMidEdgeNode (int node1, int node2)
 
int GetMidFaceNode (int en1, int en2, int en3, int en4)
 
void ReferenceElement (int elem)
 
void UnreferenceElement (int elem, Array< int > &elemFaces)
 
FaceGetFace (Element &elem, int face_no)
 
void RegisterFaces (int elem, int *fattr=NULL)
 
void DeleteUnusedFaces (const Array< int > &elemFaces)
 
void CollectDerefinements (int elem, Array< Connection > &list)
 
int RetrieveNode (const Element &el, int index)
 Return el.node[index] correctly, even if the element is refined. More...
 
int FindNodeExt (const Element &el, int node, bool abort=true)
 Extended version of find_node: works if 'el' is refined. More...
 
int ReorderFacePointMat (int v0, int v1, int v2, int v3, int elem, const PointMatrix &pm, PointMatrix &reordered) const
 
void TraverseQuadFace (int vn0, int vn1, int vn2, int vn3, const PointMatrix &pm, int level, Face *eface[4], MatrixMap &matrix_map)
 
bool TraverseTriFace (int vn0, int vn1, int vn2, const PointMatrix &pm, int level, MatrixMap &matrix_map)
 
void TraverseTetEdge (int vn0, int vn1, const Point &p0, const Point &p1, MatrixMap &matrix_map)
 
void TraverseEdge (int vn0, int vn1, double t0, double t1, int flags, int level, MatrixMap &matrix_map)
 
void FindSetNeighbors (const Array< char > &elem_set, Array< int > *neighbors, Array< char > *neighbor_set=NULL)
 
void FindNeighbors (int elem, Array< int > &neighbors, const Array< int > *search_set=NULL)
 
void NeighborExpand (const Array< int > &elems, Array< int > &expanded, const Array< int > *search_set=NULL)
 
void CollectEdgeVertices (int v0, int v1, Array< int > &indices)
 
void CollectTriFaceVertices (int v0, int v1, int v2, Array< int > &indices)
 
void CollectQuadFaceVertices (int v0, int v1, int v2, int v3, Array< int > &indices)
 
void BuildElementToVertexTable ()
 
void UpdateElementToVertexTable ()
 
int GetVertexRootCoord (int elem, RefCoord coord[3]) const
 
void CollectIncidentElements (int elem, const RefCoord coord[3], Array< int > &list) const
 
void FindVertexCousins (int elem, int local, Array< int > &cousins) const
 
void GetPointMatrix (Geometry::Type geom, const char *ref_path, DenseMatrix &matrix)
 
void TraverseRefinements (int elem, int coarse_index, std::string &ref_path, RefPathMap &map)
 
void InitDerefTransforms ()
 
void SetDerefMatrixCodes (int parent, Array< int > &fine_coarse)
 
const double * CalcVertexPos (int node) const
 
int GetEdgeMaster (int node) const
 
void FindFaceNodes (int face, int node[4])
 
int EdgeSplitLevel (int vn1, int vn2) const
 
int TriFaceSplitLevel (int vn1, int vn2, int vn3) const
 
void QuadFaceSplitLevel (int vn1, int vn2, int vn3, int vn4, int &h_level, int &v_level) const
 
void CountSplits (int elem, int splits[3]) const
 
void GetLimitRefinements (Array< Refinement > &refinements, int max_level)
 
int PrintElements (std::ostream &out, int elem, int &coarse_id) const
 
void CopyElements (int elem, const BlockArray< Element > &tmp_elements, Array< int > &index_map)
 

Static Protected Member Functions

static int get_face_orientation (Face &face, Element &e1, Element &e2, int local[2]=NULL)
 
- Static Protected Member Functions inherited from mfem::NCMesh
static int find_node (const Element &el, int node)
 
static int find_element_edge (const Element &el, int vn0, int vn1, bool abort=true)
 
static int find_local_face (int geom, int a, int b, int c)
 
static const PointMatrixGetGeomIdentity (Geometry::Type geom)
 

Protected Attributes

MPI_Comm MyComm
 
int NRanks
 
int MyRank
 
int NGhostVertices
 
int NGhostEdges
 
int NGhostFaces
 
int NElements
 
int NGhostElements
 
GroupList groups
 
GroupMap group_id
 
Array< GroupIdentity_owner [3]
 
Array< GroupIdentity_pmat_group [3]
 
Array< GroupIdentity_conf_group [3]
 
Array< int > leaf_glob_order
 
Array< int > entity_elem_local [3]
 
NCList shared_vertices
 
NCList shared_edges
 
NCList shared_faces
 
Array< char > face_orient
 
Array< char > element_type
 
Array< int > ghost_layer
 list of elements whose 'element_type' == 2. More...
 
Array< int > boundary_layer
 list of type 3 elements More...
 
Array< int > tmp_owner
 
Array< char > tmp_shared_flag
 
Array< Connectionentity_index_rank [3]
 
Array< int > tmp_neighbors
 
RebalanceDofMessage::Map send_rebalance_dofs
 
RebalanceDofMessage::Map recv_rebalance_dofs
 
Array< int > old_index_or_rank
 
Array< DenseMatrix * > aux_pm_store
 Stores modified point matrices created by GetFaceNeighbors. More...
 
- Protected Attributes inherited from mfem::NCMesh
int Dim
 
int spaceDim
 dimensions of the elements and the vertex coordinates More...
 
bool Iso
 true if the mesh only contains isotropic refinements More...
 
int Geoms
 bit mask of element geometries present, see InitGeomFlags() More...
 
HashTable< Nodenodes
 
HashTable< Facefaces
 
BlockArray< Elementelements
 
Array< int > free_element_ids
 
Array< int > root_state
 
Array< double > top_vertex_pos
 coordinates of top-level vertices (organized as triples) More...
 
int NVertices
 
int NEdges
 
int NFaces
 
Array< int > leaf_elements
 
Array< int > vertex_nodeId
 
NCList face_list
 lazy-initialized list of faces, see GetFaceList More...
 
NCList edge_list
 lazy-initialized list of edges, see GetEdgeList More...
 
NCList vertex_list
 lazy-initialized list of vertices, see GetVertexList More...
 
Array< int > boundary_faces
 subset of all faces, set by BuildFaceList More...
 
Array< char > face_geom
 face geometry by face index, set by OnMeshUpdated More...
 
Table element_vertex
 leaf-element to vertex table, see FindSetNeighbors More...
 
Array< Refinementref_stack
 stack of scheduled refinements (temporary) More...
 
HashTable< Nodeshadow
 temporary storage for reparented nodes More...
 
Array< Triple< int, int, int > > reparents
 scheduled node reparents (tmp) More...
 
Table derefinements
 possible derefinements, see GetDerefinementTable More...
 
CoarseFineTransformations transforms
 storage for data returned by Get[De]RefinementTransforms() More...
 
Array< int > coarse_elements
 state of leaf_elements before Refine(), set by MarkCoarseLevel() More...
 
TmpVertextmp_vertex
 

Friends

class ParMesh
 
class NeighborRowMessage
 

Additional Inherited Members

- Static Public Member Functions inherited from mfem::NCMesh
static void GridSfcOrdering2D (int width, int height, Array< int > &coords)
 
static void GridSfcOrdering3D (int width, int height, int depth, Array< int > &coords)
 
- Static Protected Attributes inherited from mfem::NCMesh
static PointMatrix pm_tri_identity
 
static PointMatrix pm_quad_identity
 
static PointMatrix pm_tet_identity
 
static PointMatrix pm_prism_identity
 
static PointMatrix pm_hex_identity
 
static GeomInfo GI [Geometry::NumGeom]
 

Detailed Description

A parallel extension of the NCMesh class.

The basic idea (and assumption) is that all processors share the coarsest layer ("root elements"). This has the advantage that refinements can easily be exchanged between processors when rebalancing since individual elements can be uniquely identified by the index of the root element and a path in the refinement tree.

Each leaf element is owned by one of the processors (NCMesh::Element::rank). The underlying NCMesh stores not only elements for the current ('MyRank') processor, but also a minimal layer of adjacent "ghost" elements owned by other processors. The ghost layer is synchronized after refinement.

The ghost layer contains all vertex-, edge- and face-neighbors of the current processor's region. It is used to determine constraining relations and ownership of DOFs on the processor boundary. Ghost elements are never seen by the rest of MFEM as they are skipped when a Mesh is created from the NCMesh.

The processor that owns a vertex, edge or a face (and in turn its DOFs) is currently defined to be the one with the lowest rank in the group of processors that share the entity.

Vertices, edges and faces that are not owned by this ('MyRank') processor are ghosts, and are numbered after all real vertices/edges/faces, i.e., they have indices greater than NVertices, NEdges, NFaces, respectively.

A shared vertex/edge/face is identified in an interprocessor message by a pair of numbers. The first number specifies an element in an ElementSet (typically sent at the beginning of the message) that contains the v/e/f. The second number is the local index of the v/e/f in that element.

Definition at line 64 of file pncmesh.hpp.

Member Typedef Documentation

typedef std::vector<int> mfem::ParNCMesh::CommGroup

Definition at line 131 of file pncmesh.hpp.

typedef short mfem::ParNCMesh::GroupId

Definition at line 130 of file pncmesh.hpp.

typedef std::vector<CommGroup> mfem::ParNCMesh::GroupList
protected

Definition at line 260 of file pncmesh.hpp.

typedef std::map<CommGroup, GroupId> mfem::ParNCMesh::GroupMap
protected

Definition at line 261 of file pncmesh.hpp.

Constructor & Destructor Documentation

mfem::ParNCMesh::ParNCMesh ( MPI_Comm  comm,
const NCMesh ncmesh,
int *  part = NULL 
)

Definition at line 28 of file pncmesh.cpp.

mfem::ParNCMesh::ParNCMesh ( const ParNCMesh other)

Definition at line 49 of file pncmesh.cpp.

mfem::ParNCMesh::~ParNCMesh ( )
virtual

Definition at line 59 of file pncmesh.cpp.

Member Function Documentation

void mfem::ParNCMesh::AddConnections ( int  entity,
int  index,
const Array< int > &  ranks 
)
protected

Definition at line 604 of file pncmesh.cpp.

void mfem::ParNCMesh::AdjustMeshIds ( Array< MeshId ids[],
int  rank 
)
protected

Adjust some of the MeshIds before encoding for recipient 'rank', so that they only reference elements that exist in the recipient's ref. tree.

Definition at line 2387 of file pncmesh.cpp.

void mfem::ParNCMesh::AssignLeafIndices ( )
protectedvirtual

Reimplemented from mfem::NCMesh.

Definition at line 92 of file pncmesh.cpp.

void mfem::ParNCMesh::BuildEdgeList ( )
protectedvirtual

Reimplemented from mfem::NCMesh.

Definition at line 357 of file pncmesh.cpp.

void mfem::ParNCMesh::BuildFaceList ( )
protectedvirtual

Reimplemented from mfem::NCMesh.

Definition at line 295 of file pncmesh.cpp.

void mfem::ParNCMesh::BuildVertexList ( )
protectedvirtual

Reimplemented from mfem::NCMesh.

Definition at line 412 of file pncmesh.cpp.

void mfem::ParNCMesh::CalcFaceOrientations ( )
protected

Definition at line 715 of file pncmesh.cpp.

void mfem::ParNCMesh::CalculatePMatrixGroups ( )
protected

Definition at line 612 of file pncmesh.cpp.

void mfem::ParNCMesh::ChangeEdgeMeshIdElement ( NCMesh::MeshId id,
int  elem 
)
protected

Definition at line 2488 of file pncmesh.cpp.

void mfem::ParNCMesh::ChangeRemainingMeshIds ( Array< MeshId > &  ids,
int  pos,
const Array< Pair< int, int > > &  find 
)
protected

Definition at line 2514 of file pncmesh.cpp.

void mfem::ParNCMesh::ChangeVertexMeshIdElement ( NCMesh::MeshId id,
int  elem 
)
protected

Definition at line 2470 of file pncmesh.cpp.

void mfem::ParNCMesh::CheckDerefinementNCLevel ( const Table deref_table,
Array< int > &  level_ok,
int  max_nc_level 
)
virtual

Parallel version of NCMesh::CheckDerefinementNCLevel.

Reimplemented from mfem::NCMesh.

Definition at line 1738 of file pncmesh.cpp.

bool mfem::ParNCMesh::CheckElementType ( int  elem,
int  type 
)
protected

Definition at line 804 of file pncmesh.cpp.

void mfem::ParNCMesh::ClearAuxPM ( )
protected

Definition at line 1307 of file pncmesh.cpp.

void mfem::ParNCMesh::CreateGroups ( int  nentities,
Array< Connection > &  index_rank,
Array< GroupId > &  entity_group 
)
protected

Definition at line 570 of file pncmesh.cpp.

void mfem::ParNCMesh::DecodeGroups ( std::istream &  is,
Array< GroupId > &  ids 
)
protected

Definition at line 2668 of file pncmesh.cpp.

void mfem::ParNCMesh::DecodeMeshIds ( std::istream &  is,
Array< MeshId ids[] 
)
protected

Definition at line 2569 of file pncmesh.cpp.

void mfem::ParNCMesh::Derefine ( const Array< int > &  derefs)
virtual

Parallel reimplementation of NCMesh::Derefine, keeps ghost layers in sync. The interface is identical.

Reimplemented from mfem::NCMesh.

Definition at line 1486 of file pncmesh.cpp.

void mfem::ParNCMesh::ElementNeighborProcessors ( int  elem,
Array< int > &  ranks 
)
protected

Return a list of processors that own elements in the immediate neighborhood of 'elem' (i.e., vertex, edge and face neighbors), and are not 'MyRank'.

Definition at line 821 of file pncmesh.cpp.

int mfem::ParNCMesh::ElementRank ( int  index) const
inline

Returns owner processor for element 'index'. This is normally MyRank but for index >= NElements (i.e., for ghosts) it may be something else.

Definition at line 188 of file pncmesh.hpp.

void mfem::ParNCMesh::ElementSharesEdge ( int  elem,
int  local,
int  enode 
)
protectedvirtual

Reimplemented from mfem::NCMesh.

Definition at line 332 of file pncmesh.cpp.

void mfem::ParNCMesh::ElementSharesFace ( int  elem,
int  local,
int  face 
)
protectedvirtual

Reimplemented from mfem::NCMesh.

Definition at line 272 of file pncmesh.cpp.

void mfem::ParNCMesh::ElementSharesVertex ( int  elem,
int  local,
int  vnode 
)
protectedvirtual

Reimplemented from mfem::NCMesh.

Definition at line 389 of file pncmesh.cpp.

void mfem::ParNCMesh::EncodeGroups ( std::ostream &  os,
const Array< GroupId > &  ids 
)
protected

Definition at line 2626 of file pncmesh.cpp.

void mfem::ParNCMesh::EncodeMeshIds ( std::ostream &  os,
Array< MeshId ids[] 
)
protected

Definition at line 2526 of file pncmesh.cpp.

int mfem::ParNCMesh::get_face_orientation ( Face face,
Element e1,
Element e2,
int  local[2] = NULL 
)
staticprotected

Definition at line 686 of file pncmesh.cpp.

void mfem::ParNCMesh::GetBoundaryClosure ( const Array< int > &  bdr_attr_is_ess,
Array< int > &  bdr_vertices,
Array< int > &  bdr_edges 
)
virtual

Extension of NCMesh::GetBoundaryClosure. Filters out ghost vertices and ghost edges from 'bdr_vertices' and 'bdr_edges'.

Reimplemented from mfem::NCMesh.

Definition at line 741 of file pncmesh.cpp.

void mfem::ParNCMesh::GetConformingSharedStructures ( class ParMesh pmesh)
protected

For compatibility with conforming code in ParMesh and ParFESpace. Initializes shared structures in ParMesh: gtopo, shared_*, group_s*, s*_l*. The ParMesh then acts as a parallel mesh cut along the NC interfaces.

Definition at line 930 of file pncmesh.cpp.

void mfem::ParNCMesh::GetDebugMesh ( Mesh debug_mesh) const

Extract a debugging Mesh containing all leaf elements, including ghosts. The debug mesh will have element attributes set to element rank + 1.

Definition at line 2832 of file pncmesh.cpp.

const Array<int>& mfem::ParNCMesh::GetDerefineOldRanks ( ) const
inline

Get previous (pre-Derefine) fine element ranks. This complements the CoarseFineTransformations::embeddings array in parallel.

Definition at line 211 of file pncmesh.hpp.

GroupId mfem::ParNCMesh::GetEntityGroupId ( int  entity,
int  index 
)
inline

Return the P matrix communication group ID for a vertex/edge/face. The groups are calculated specifically to match the P matrix construction algorithm and its communication pattern.

Definition at line 148 of file pncmesh.hpp.

GroupId mfem::ParNCMesh::GetEntityOwnerId ( int  entity,
int  index 
)
inline

Return vertex/edge/face ('entity' == 0/1/2, resp.) owner.

Definition at line 134 of file pncmesh.hpp.

void mfem::ParNCMesh::GetFaceNeighbors ( class ParMesh pmesh)
protected

Populate face neighbor members of ParMesh from the ghost layer, without communication.

Definition at line 1031 of file pncmesh.cpp.

int mfem::ParNCMesh::GetFaceOrientation ( int  index) const
inline

Return (shared) face orientation relative to its owner element.

Definition at line 125 of file pncmesh.hpp.

const CommGroup& mfem::ParNCMesh::GetGroup ( GroupId  id) const
inline

Return a list of ranks contained in the group of the given ID.

Definition at line 160 of file pncmesh.hpp.

ParNCMesh::GroupId mfem::ParNCMesh::GetGroupId ( const CommGroup group)
protected

Definition at line 534 of file pncmesh.cpp.

int mfem::ParNCMesh::GetMyRank ( ) const
inline

Definition at line 196 of file pncmesh.hpp.

int mfem::ParNCMesh::GetNElements ( ) const
inline

Definition at line 100 of file pncmesh.hpp.

int mfem::ParNCMesh::GetNGhostEdges ( ) const
inline

Definition at line 103 of file pncmesh.hpp.

int mfem::ParNCMesh::GetNGhostElements ( ) const
inline

Definition at line 105 of file pncmesh.hpp.

int mfem::ParNCMesh::GetNGhostFaces ( ) const
inline

Definition at line 104 of file pncmesh.hpp.

int mfem::ParNCMesh::GetNGhostVertices ( ) const
inline

Definition at line 102 of file pncmesh.hpp.

virtual int mfem::ParNCMesh::GetNumGhostElements ( ) const
inlineprotectedvirtual

Reimplemented from mfem::NCMesh.

Definition at line 297 of file pncmesh.hpp.

virtual int mfem::ParNCMesh::GetNumGhostVertices ( ) const
inlineprotectedvirtual

Reimplemented from mfem::NCMesh.

Definition at line 298 of file pncmesh.hpp.

const Array<int>& mfem::ParNCMesh::GetRebalanceOldIndex ( ) const
inline

Get previous indices (pre-Rebalance) of current elements. Index of -1 indicates that an element didn't exist in the mesh before.

Definition at line 207 of file pncmesh.hpp.

const NCList& mfem::ParNCMesh::GetSharedEdges ( )
inline

Definition at line 110 of file pncmesh.hpp.

const NCList& mfem::ParNCMesh::GetSharedFaces ( )
inline

Definition at line 111 of file pncmesh.hpp.

const NCList& mfem::ParNCMesh::GetSharedList ( int  entity)
inline

Helper to get shared vertices/edges/faces ('entity' == 0/1/2 resp.).

Definition at line 114 of file pncmesh.hpp.

const NCList& mfem::ParNCMesh::GetSharedVertices ( )
inline

Definition at line 109 of file pncmesh.hpp.

ParNCMesh::GroupId mfem::ParNCMesh::GetSingletonGroup ( int  rank)
protected

Definition at line 550 of file pncmesh.cpp.

bool mfem::ParNCMesh::GroupContains ( GroupId  id,
int  rank 
) const

Return true if group 'id' contains the given rank.

Definition at line 559 of file pncmesh.cpp.

long mfem::ParNCMesh::GroupsMemoryUsage ( ) const
protected

Definition at line 2890 of file pncmesh.cpp.

int mfem::ParNCMesh::InitialPartition ( int  index) const
inlineprotected

Helper to get the partitioning when the serial mesh gets split initially.

Definition at line 305 of file pncmesh.hpp.

void mfem::ParNCMesh::InitOwners ( int  num,
Array< GroupId > &  entity_owner 
)
protected

Definition at line 444 of file pncmesh.cpp.

bool mfem::ParNCMesh::IsGhost ( int  entity,
int  index 
) const
inline

Return true if the specified vertex/edge/face is a ghost.

Definition at line 170 of file pncmesh.hpp.

virtual bool mfem::ParNCMesh::IsGhost ( const Element el) const
inlineprotectedvirtual

Reimplemented from mfem::NCMesh.

Definition at line 294 of file pncmesh.hpp.

void mfem::ParNCMesh::LimitNCLevel ( int  max_nc_level)
virtual

Parallel version of NCMesh::LimitNCLevel.

Reimplemented from mfem::NCMesh.

Definition at line 1468 of file pncmesh.cpp.

void mfem::ParNCMesh::MakeSharedList ( const NCList list,
NCList shared 
)
protected

Definition at line 454 of file pncmesh.cpp.

void mfem::ParNCMesh::MakeSharedTable ( int  ngroups,
int  ent,
Array< int > &  shared_local,
Table group_shared,
Array< char > *  entity_geom = NULL,
char  geom = 0 
)
protected

Definition at line 870 of file pncmesh.cpp.

long mfem::ParNCMesh::MemoryUsage ( bool  with_base = true) const

Return total number of bytes allocated.

Definition at line 2913 of file pncmesh.cpp.

void mfem::ParNCMesh::NeighborProcessors ( Array< int > &  neighbors)
protected

Get a list of ranks that own elements in the neighborhood of our region. NOTE: MyRank is not included.

Definition at line 853 of file pncmesh.cpp.

void mfem::ParNCMesh::OnMeshUpdated ( Mesh mesh)
protectedvirtual

Get edge and face numbering from 'mesh' (i.e., set all Edge::index and Face::index) after a new mesh was created from us.

Reimplemented from mfem::NCMesh.

Definition at line 186 of file pncmesh.cpp.

int mfem::ParNCMesh::Partition ( long  index,
long  total_elements 
) const
inlineprotected

Return the processor number for a global element number.

Definition at line 301 of file pncmesh.hpp.

long mfem::ParNCMesh::PartitionFirstIndex ( int  rank,
long  total_elements 
) const
inlineprotected

Return the global index of the first element owned by processor 'rank'.

Definition at line 309 of file pncmesh.hpp.

int mfem::ParNCMesh::PrintMemoryDetail ( bool  with_base = true) const

Definition at line 2948 of file pncmesh.cpp.

void mfem::ParNCMesh::Prune ( )
protected

Traverse the (local) refinement tree and determine which subtrees are no longer needed, i.e., their leaves are not owned by us nor are they our ghosts. These subtrees are then derefined.

Definition at line 1356 of file pncmesh.cpp.

bool mfem::ParNCMesh::PruneTree ( int  elem)
protected

Internal. Recursive part of Prune().

Definition at line 1319 of file pncmesh.cpp.

void mfem::ParNCMesh::Rebalance ( const Array< int > *  custom_partition = NULL)

Migrate leaf elements of the global refinement hierarchy (including ghost elements) so that each processor owns the same number of leaves (+-1). The default partitioning strategy is based on equal splitting of the space-filling sequence of leaf elements (custom_partition == NULL). Alternatively, a used-defined element-rank assignment array can be passed.

Definition at line 1796 of file pncmesh.cpp.

void mfem::ParNCMesh::RecvRebalanceDofs ( Array< int > &  elements,
Array< long > &  dofs 
)

Receive element DOFs sent by SendRebalanceDofs().

Definition at line 2166 of file pncmesh.cpp.

void mfem::ParNCMesh::RedistributeElements ( Array< int > &  new_ranks,
int  target_elements,
bool  record_comm 
)
protected

Assign new Element::rank to leaf elements and send them to their new owners, keeping the ghost layer up to date. Used by Rebalance() and Derefine(). 'target_elements' is the number of elements this rank is supposed to own after the exchange. If this number is not known a priori, the parameter can be set to -1, but more expensive communication (synchronous sends and a barrier) will be used in that case.

Definition at line 1858 of file pncmesh.cpp.

void mfem::ParNCMesh::Refine ( const Array< Refinement > &  refinements)
virtual

An override of NCMesh::Refine, which is called eventually, after making sure that refinements that occur on the processor boundary are sent to the neighbor processors so they can keep their ghost layers up to date.

Reimplemented from mfem::NCMesh.

Definition at line 1390 of file pncmesh.cpp.

void mfem::ParNCMesh::SendRebalanceDofs ( int  old_ndofs,
const Table old_element_dofs,
long  old_global_offset,
FiniteElementSpace space 
)

Use the communication pattern from last Rebalance() to send element DOFs.

Definition at line 2133 of file pncmesh.cpp.

template<typename Type >
template void mfem::ParNCMesh::SynchronizeDerefinementData< double > ( Array< Type > &  elem_data,
const Table deref_table 
)

Exchange element data for derefinements that straddle processor boundaries. 'elem_data' is enlarged and filled with ghost values.

Definition at line 1658 of file pncmesh.cpp.

void mfem::ParNCMesh::Trim ( )
virtual

Save memory by releasing all non-essential and cached data.

Reimplemented from mfem::NCMesh.

Definition at line 2849 of file pncmesh.cpp.

void mfem::ParNCMesh::Update ( )
protectedvirtual

Apart from the primary data structure, which is the element/node/face hierarchy, there is secondary data that is derived from the primary data and needs to be updated when the primary data changes. Update() takes care of that and needs to be called after refinement and derefinement.

Reimplemented from mfem::NCMesh.

Definition at line 64 of file pncmesh.cpp.

void mfem::ParNCMesh::UpdateLayers ( )
protected

Definition at line 766 of file pncmesh.cpp.

void mfem::ParNCMesh::UpdateVertices ( )
protectedvirtual

update Vertex::index and vertex_nodeId

Reimplemented from mfem::NCMesh.

Definition at line 140 of file pncmesh.cpp.

Friends And Related Function Documentation

friend class NeighborRowMessage
friend

Definition at line 545 of file pncmesh.hpp.

friend class ParMesh
friend

Definition at line 240 of file pncmesh.hpp.

Member Data Documentation

Array<DenseMatrix*> mfem::ParNCMesh::aux_pm_store
protected

Stores modified point matrices created by GetFaceNeighbors.

Definition at line 540 of file pncmesh.hpp.

Array<int> mfem::ParNCMesh::boundary_layer
protected

list of type 3 elements

Definition at line 290 of file pncmesh.hpp.

Array<char> mfem::ParNCMesh::element_type
protected

Type of each leaf element: 1 - our element (rank == MyRank), 3 - our element, and neighbor to the ghost layer, 2 - ghost layer element (existing element, but rank != MyRank), 0 - element beyond the ghost layer, may not be a real element. Note: indexed by Element::index. See also UpdateLayers().

Definition at line 287 of file pncmesh.hpp.

Array<GroupId> mfem::ParNCMesh::entity_conf_group[3]
protected

Definition at line 272 of file pncmesh.hpp.

Array<int> mfem::ParNCMesh::entity_elem_local[3]
protected

Definition at line 274 of file pncmesh.hpp.

Array<Connection> mfem::ParNCMesh::entity_index_rank[3]
protected

Definition at line 329 of file pncmesh.hpp.

Array<GroupId> mfem::ParNCMesh::entity_owner[3]
protected

Definition at line 267 of file pncmesh.hpp.

Array<GroupId> mfem::ParNCMesh::entity_pmat_group[3]
protected

Definition at line 269 of file pncmesh.hpp.

Array<char> mfem::ParNCMesh::face_orient
protected

Definition at line 279 of file pncmesh.hpp.

Array<int> mfem::ParNCMesh::ghost_layer
protected

list of elements whose 'element_type' == 2.

Definition at line 289 of file pncmesh.hpp.

GroupMap mfem::ParNCMesh::group_id
protected

Definition at line 264 of file pncmesh.hpp.

GroupList mfem::ParNCMesh::groups
protected

Definition at line 263 of file pncmesh.hpp.

Array<int> mfem::ParNCMesh::leaf_glob_order
protected

Definition at line 274 of file pncmesh.hpp.

MPI_Comm mfem::ParNCMesh::MyComm
protected

Definition at line 254 of file pncmesh.hpp.

int mfem::ParNCMesh::MyRank
protected

Definition at line 255 of file pncmesh.hpp.

int mfem::ParNCMesh::NElements
protected

Definition at line 258 of file pncmesh.hpp.

int mfem::ParNCMesh::NGhostEdges
protected

Definition at line 257 of file pncmesh.hpp.

int mfem::ParNCMesh::NGhostElements
protected

Definition at line 258 of file pncmesh.hpp.

int mfem::ParNCMesh::NGhostFaces
protected

Definition at line 257 of file pncmesh.hpp.

int mfem::ParNCMesh::NGhostVertices
protected

Definition at line 257 of file pncmesh.hpp.

int mfem::ParNCMesh::NRanks
protected

Definition at line 255 of file pncmesh.hpp.

Array<int> mfem::ParNCMesh::old_index_or_rank
protected

After Rebalance, this array holds the old element indices, or -1 if an element didn't exist in the mesh previously. After Derefine, it holds the ranks of the old (potentially non-existent) fine elements.

Definition at line 537 of file pncmesh.hpp.

RebalanceDofMessage::Map mfem::ParNCMesh::recv_rebalance_dofs
protected

Definition at line 532 of file pncmesh.hpp.

RebalanceDofMessage::Map mfem::ParNCMesh::send_rebalance_dofs
protected

Recorded communication pattern from last Rebalance. Used by Send/RecvRebalanceDofs to ship element DOFs.

Definition at line 531 of file pncmesh.hpp.

NCList mfem::ParNCMesh::shared_edges
protected

Definition at line 277 of file pncmesh.hpp.

NCList mfem::ParNCMesh::shared_faces
protected

Definition at line 277 of file pncmesh.hpp.

NCList mfem::ParNCMesh::shared_vertices
protected

Definition at line 277 of file pncmesh.hpp.

Array<int> mfem::ParNCMesh::tmp_neighbors
protected

Definition at line 408 of file pncmesh.hpp.

Array<int> mfem::ParNCMesh::tmp_owner
protected

Definition at line 327 of file pncmesh.hpp.

Array<char> mfem::ParNCMesh::tmp_shared_flag
protected

Definition at line 328 of file pncmesh.hpp.


The documentation for this class was generated from the following files: