The Evolution of Turbulent Micro vortices and their Effect on Convection Heat Transfer in Porous Media. New insight into the contribution of the microscale vortex evolution towards convection heat transfer in porous media is presented in this paper. The objective is to determine how the microscale vortices influence convection heat transfer in turbulent flow inside porous media. The microscale temperature distribution is analyzed using flow visualization in 2D using streamlines and in 3D using Q structures. The pertinent observations are supplemented with the comparison of surface skin friction and heat transfer using (1) surface skin friction lines and (2) joint PDF of pressure and skin friction coefficients, along with the Nusselt number. The microscale flow phenomena observed are corroborated with the features of the frequency spectra of the drag coefficient and macroscale Nusselt number. The Large Eddy Simulation technique is used to investigate the flow field inside a periodic porous medium. The Reynolds numbers of the flow are 300 and 500. The porous medium consists of solid obstacles in the shape of square and circular cylinders. Two distinct flow regimes are represented by using the porosities of 0.50 and 0.87. The results show that the surface Nusselt number distribution is dependent on whether the micro vortices are attached to or detached from the surface of the obstacle. The spectra of the macroscale Nusselt number and the pressure drag are similar signifying a correlation between the dynamics of heat transfer and the microscale turbulent structures. Both vortex shedding and secondary flow instabilities are observed that significantly influence the Nusselt number. The fundamental insight gained in this paper can inform the development of more robust macroscale models of convection heat transfer in turbulent flow in porous media.


Sliding motion on tangential sets of Filippov systems. We consider piecewise smooth vector fields Z (Z , Z ) defined in mathbb R n where both vector fields are tangent to the switching manifold Sigma along a manifold M . Our main purpose is to study the existence of an invariant vector field defined on M , that we call tangential sliding vector field. We provide necessary and sufficient conditions under Z to characterize the existence of this vector field. Considering a regularization process, we proved that this tangential sliding vector field is topological equivalent to an invariant dynamics under the slow manifold. The results are applied to study a Filippov model for intermittent treatment of HIV.


Liouville theorem on a half space for biharmonic problem with Dirichlet boundary condition. We investigate here the nonlinear elliptic H 'enon type equation D 2 u x a u p 1 u , , mbox in , , , , R n , quad quad u frac partial u partial x n 0 quad mbox in , , , , partial R n , with p 1 and n geq 2 . In particular, we prove some Liouville type theorems for stable at infinity solutions. The main methods used are the integral estimates, the Pohozaev type identity and the monotonicity formula.


Cohomology of the Schr "odinger Virasoro conformal algebra. Both the basic cohomology groups and the reduced cohomology groups of the Schr "odinger Virasoro conformal algebra with trivial coefficients are completely determined.


Cardinality constrained submodular maximization for random streams. We consider the problem of maximizing submodular functions in single pass streaming and secretaries with shortlists models, both with random arrival order. For cardinality constrained monotone functions, Agrawal, Shadravan, and Stein gave a single pass (1 1 e varepsilon) approximation algorithm using only linear memory, but their exponential dependence on varepsilon makes it impractical even for varepsilon 0.1 . We simplify both the algorithm and the analysis, obtaining an exponential improvement in the varepsilon dependence (in particular, O(k varepsilon) memory). Extending these techniques, we also give a simple (1 e varepsilon) approximation for non monotone functions in O(k varepsilon) memory. For the monotone case, we also give a corresponding unconditional hardness barrier of 1 1 e varepsilon for single pass algorithms in randomly ordered streams, even assuming unlimited computation. Finally, we show that the algorithms are simple to implement and work well on real world datasets.


Post fabrication trimming of photonic integrated circuits by local laser oxidation of titanium film. Local laser oxidation of a thin titanium film is considered as a means for achieving a precise adjustment of absorption coefficient and effective refractive index of dielectric optical waveguides. A fine phase tuning of an operating point and extinction ratio enhancement up to 57 dB were demonstrated on an integrated optical Ti LiNbO3 Mach Zehnder modulator. The technique affects only slightly the dielectric waveguide material and is very promising for a high accuracy permanent trimming of photonic devices based on dielectric waveguides of different material platforms and fabrication technologies.


Discovering Redundant Activities in Event Logs for the Simplification of Process Models. Process mining acts as a valuable tool to analyse the behaviour of an organisation by offering techniques to discover, monitor and enhance real processes. The key to process mining is to discovery understandable process models. However, real life logs can be complex with redundant activities, which share similar behaviour but have different syntax. We show that the existence of such redundant activities heavily affects the quality of discovered process models. Existing approaches filter activities by frequency, which cannot solve problems caused by redundant activities. In this paper, we propose first to discover redundant activities in the log level and, then, use the discovery results to simplify event logs. Two publicly available data sets are used to evaluate the usability of our approach in real life processes. Our approach can be adopted as a preprocessing step before applying any discovery algorithms to produce simplify models.


Characterizing User Susceptibility to COVID 19 Misinformation on Twitter. Though significant efforts such as removing false claims and promoting reliable sources have been increased to combat COVID 19 "misinfodemic", it remains an unsolved societal challenge if lacking a proper understanding of susceptible online users, i.e., those who are likely to be attracted by, believe and spread misinformation. This study attempts to answer it who constitutes the population vulnerable to the online misinformation in the pandemic, and what are the robust features and short term behavior signals that distinguish susceptible users from others. Using a 6 month longitudinal user panel on Twitter collected from a geopolitically diverse network stratified samples in the US, we distinguish different types of users, ranging from social bots to humans with various level of engagement with COVID related misinformation. We then identify users' online features and situational predictors that correlate with their susceptibility to COVID 19 misinformation. This work brings unique contributions First, contrary to the prior studies on bot influence, our analysis shows that social bots' contribution to misinformation sharing was surprisingly low, and human like users' misinformation behaviors exhibit heterogeneity and temporal variability. While the sharing of misinformation was highly concentrated, the risk of occasionally sharing misinformation for average users remained alarmingly high. Second, our findings highlight the political sensitivity activeness and responsiveness to emotionally charged content among susceptible users. Third, we demonstrate a feasible solution to efficiently predict users' transient susceptibility solely based on their short term news consumption and exposure from their networks. Our work has an implication in designing effective intervention mechanism to mitigate the misinformation dissipation.


Critical Tori for Mean Curvature Energies in Killing Submersions. We study surface energies depending on the mean curvature in total spaces of Killing submersions, which extend the classical notion of Willmore energy. Based on a symmetry reduction procedure, we construct vertical tori critical for these mean curvature energies. These vertical tori are based on closed curves critical for curvature energy functionals in Riemannian 2 space forms. The binormal evolution of these critical curves in Riemannian 3 space forms generates rotational tori solutions for an ample family of Weingarten surfaces. Therefore, we also introduce some correspondence results between these two types of tori and illustrate their relation.


Necessary and sufficient conditions for the convergence of positive series. We provide new necessary and sufficient conditions for the convergence of positive series developing Bertran De Morgan and Cauchy type tests given in M. Martin, Bull. Amer. Math. Soc. 47(1941), 452 457 and L. Bourchtein et al, Int. J. Math. Anal. 6(2012), 1847 1869 . The obtained result enables us to extend the known conditions for recurrence and transience of birth and death processes given in V. M. Abramov, Amer. Math. Monthly 127(2020) 444 448 .


Open or Sneaky? Fast or Slow? Light or Heavy? Investigating Security Releases of Open Source Packages. Vulnerabilities in open source packages can be a security risk for the client projects that use these packages as dependencies. When a new vulnerability is discovered in a package, the package should quickly release a fix in a new version, referred to as security release in this study. The security release should be well documented and require minimal migration effort to facilitate fast adoption by the client projects. However, to what extent the open source packages follow these recommendations is not known. The goal of this study is to aid software practitioners and researchers in understanding the current practice of releasing security fixes by open source packages and identifying areas for improvement through an empirical study of security releases. Specifically, in this paper, we study (1) the time lag between fix and release (2) how security fixes are documented in the release notes (3) code change characteristics (size and semantic versioning) of the release and (4) the time lag between the release and an advisory publication on Snyk or NVD (two popular vulnerability databases) for security releases over a dataset of 4,377 security advisories across seven package ecosystems. We find that the median security release is available in under 4 days of the corresponding fix and contains 134 lines of code (LOC) change. Further, we find that 61.5 of the security releases come with a release note that documents the corresponding security fix. However, Snyk and NVD may take a median of 25 days (from the release) to publish an advisory for these security releases, possibly resulting in delayed notification to the client projects. Based on our findings, we make four recommendations for the package maintainers and the ecosystem administrators, such as using private fork for security fixes and standardizing the practice for announcing security releases.


Code O SUKI N 3D Upgraded Direct Drive Fuel Target 3D Implosion Code in Heavy Ion Inertial Fusion. The Code O SUKI N 3D is an upgraded version of the 2D Code O SUKI (Comput. Phys. Commun. 240, 83 (2019)). Code O SUKI N 3D is an integrated 3 dimensional (3D) simulation program system for fuel implosion, ignition and burning of a direct drive nuclear fusion pellet in heavy ion beam (HIB) inertial confinement fusion (HIF).The Code O SUKI N 3D consists of the three programs of Lagrangian fluid implosion program, data conversion program, and Euler fluid implosion, ignition and burning program. The Code O SUKI N 3D can also couple with the HIB illumination and energy deposition program of OK3 (Comput. Phys. Commun. 181, 1332 (2010)). The spherical target implosion 3D behavior is computed by the 3D Lagrangian fluid code until the time just before the void closure of the fuel implosion. After that, all the data by the Lagrangian implosion code are converted to the data for the 3D Eulerian code. In the 3D Euler code, the DT fuel compression at the stagnation, ignition and burning are computed. The Code O SUKI N 3D simulation system provides a capability to compute and to study the HIF target implosion dynamics.


A Novel Metric for Evaluating Semantics Preservation. In this paper, we leverage pre trained language models (PLMs) to precisely evaluate the semantics preservation of edition process on sentences. Our metric, Neighbor Distribution Divergence (NDD), evaluates the disturbance on predicted distribution of neighboring words from mask language model (MLM). NDD is capable of detecting precise changes in semantics which are easily ignored by text similarity. By exploiting the property of NDD, we implement a unsupervised and even training free algorithm for extractive sentence compression. We show that our NDD based algorithm outperforms previous perplexity based unsupervised algorithm by a large margin. For further exploration on interpretability, we evaluate NDD by pruning on syntactic dependency treebanks and apply NDD for predicate detection as well.


Aposteriori error estimation of Subgrid multiscale stabilized finite element method for transient Stokes model. In this study, we present a novel stabilized finite element analysis for transient Stokes model. The algebraic subgrid multiscale approach has been employed to arrive at the stabilized coupled variational formulation. Derivation of the stabilized form as well as stability analysis of it's fully discrete formulation are presented elaborately. Discrete inf sup condition for pressure stabilization has been proven. For the time discretization the fully implicit schemes have been used. A detailed derivation of the aposteriori error estimate for the stabilized subgrid multiscale finite element scheme has been presented. Numerical experiment has been carried out to verify theoretically established order of convergence.


FuSeConv Fully Separable Convolutions for Fast Inference on Systolic Arrays. Both efficient neural networks and hardware accelerators are being explored to speed up DNN inference on edge devices. For example, MobileNet uses depthwise separable convolution to achieve much lower latency, while systolic arrays provide much higher performance per watt. Interestingly however, the combination of these two ideas is inefficient The computational patterns of depth wise separable convolution are not systolic and lack data reuse to saturate the systolic array's constrained dataflow. In this paper, we propose FuSeConv (Fully Separable Convolution) as a drop in replacement for depth wise separable convolution. FuSeConv generalizes the decomposition of convolutions fully to separable 1D convolutions along spatial and depth dimensions. The resultant computation is systolic and efficiently utilizes the systolic array with a slightly modified dataflow. With FuSeConv, we achieve a significant speed up of 3x 7x with the MobileNet family of networks on a systolic array of size 64x64, with comparable accuracy on the ImageNet dataset. The high speed up motivates exploration of hardware aware Neural Operator Search (NOS) in complement to ongoing efforts on Neural Architecture Search (NAS).


Real time Adversarial Perturbations against Deep Reinforcement Learning Policies Attacks and Defenses. Recent work has shown that deep reinforcement learning (DRL) policies are vulnerable to adversarial perturbations. Adversaries can mislead policies of DRL agents by perturbing the state of the environment observed by the agents. Existing attacks are feasible in principle but face challenges in practice, either by being too slow to fool DRL policies in real time or by modifying past observations stored in the agent's memory. We show that using the Universal Adversarial Perturbation (UAP) method to compute perturbations, independent of the individual inputs to which they are applied to, can fool DRL policies effectively and in real time. We describe three such attack variants. Via an extensive evaluation using three Atari 2600 games, we show that our attacks are effective, as they fully degrade the performance of three different DRL agents (up to 100 , even when the l infty bound on the perturbation is as small as 0.01). It is faster compared to the response time (0.6ms on average) of different DRL policies, and considerably faster than prior attacks using adversarial perturbations (1.8ms on average). We also show that our attack technique is efficient, incurring an online computational cost of 0.027ms on average. Using two further tasks involving robotic movement, we confirm that our results generalize to more complex DRL tasks. Furthermore, we demonstrate that the effectiveness of known defenses diminishes against universal perturbations. We propose an effective technique that detects all known adversarial perturbations against DRL policies, including all the universal perturbations presented in this paper.


Pressure robust staggered DG methods for the Navier Stokes equations on general meshes. In this paper, we design and analyze staggered discontinuous Galerkin methods of arbitrary polynomial orders for the stationary Navier Stokes equations on polygonal meshes. The exact divergence free condition for the velocity is satisfied without any postprocessing. The resulting method is pressure robust so that the pressure approximation does not influence the velocity approximation. A new nonlinear convective term that earning non negativity is proposed. The optimal convergence estimates for all the variables in L 2 norm are proved. Also, assuming that the rotational part of the forcing term is small enough, we are able to prove that the velocity error is independent of the Reynolds number and of the pressure. Furthermore, superconvergence can be achieved for velocity under a suitable projection. Numerical experiments are provided to validate the theoretical findings and demonstrate the performances of the proposed method.


GraphCode2Vec Generic Code Embedding via Lexical and Program Dependence Analyses. Code embedding is a keystone in the application of machine learning on several Software Engineering (SE) tasks. To effectively support a plethora of SE tasks, the embedding needs to capture program syntax and semantics in a way that is generic. To this end, we propose the first self supervised pre training approach (called GraphCode2Vec) which produces task agnostic embedding of lexical and program dependence features. GraphCode2Vec achieves this via a synergistic combination of code analysis and Graph Neural Networks. GraphCode2Vec is generic, it allows pre training, and it is applicable to several SE downstream tasks. We evaluate the effectiveness of GraphCode2Vec on four (4) tasks (method name prediction, solution classification, mutation testing and overfitted patch classification), and compare it with four (4) similarly generic code embedding baselines (Code2Seq, Code2Vec, CodeBERT, GraphCodeBERT) and 7 task specific, learning based methods. In particular, GraphCode2Vec is more effective than both generic and task specific learning based baselines. It is also complementary and comparable to GraphCodeBERT (a larger and more complex model). We also demonstrate through a probing and ablation study that GraphCode2Vec learns lexical and program dependence features and that self supervised pre training improves effectiveness.


Computer algebra in Julia. Recently, the place of the main programming language for scientific and engineering computations has been little by little taken by Julia. Some users want to work completely within the Julia framework as they work within the Python framework. There are libraries for Julia that cover the majority of scientific and engineering computations demands. The aim of this paper is to combine the usage of the Julia framework for numerical computations and for symbolic computations in mathematical modeling problems. The main functional domains determining various variants of the application of computer algebra systems are described. In each of these domains, generic representatives of computer algebra systems in Julia are distinguished. The conclusion is that it is possible (and even convenient) to use computer algebra systems within the Julia framework.


An empirical study of question discussions on Stack Overflow. Stack Overflow provides a means for developers to exchange knowledge. While much previous research on Stack Overflow has focused on questions and answers (Q A), recent work has shown that discussions in comments also contain rich information. On Stack Overflow, discussions through comments and chat rooms can be tied to questions or answers. In this paper, we conduct an empirical study that focuses on the nature of question discussions. We observe that (1) Question discussions occur at all phases of the Q A process, with most beginning before the first answer is received. (2) Both askers and answerers actively participate in question discussions the likelihood of their participation increases as the number of comments increases. (3) There is a strong correlation between the number of question comments and the question answering time (i.e., more discussed questions receive answers more slowly) also, questions with a small number of comments are likely to be answered more quickly than questions with no discussion. Our findings suggest that question discussions contain a rich trove of data that is integral to the Q A processes on Stack Overflow. We further suggest how future research can leverage the information in question discussions, along with the commonly studied Q A information.


Adaptive Information Seeking for Open Domain Question Answering. Information seeking is an essential step for open domain question answering to efficiently gather evidence from a large corpus. Recently, iterative approaches have been proven to be effective for complex questions, by recursively retrieving new evidence at each step. However, almost all existing iterative approaches use predefined strategies, either applying the same retrieval function multiple times or fixing the order of different retrieval functions, which cannot fulfill the diverse requirements of various questions. In this paper, we propose a novel adaptive information seeking strategy for open domain question answering, namely AISO. Specifically, the whole retrieval and answer process is modeled as a partially observed Markov decision process, where three types of retrieval operations (e.g., BM25, DPR, and hyperlink) and one answer operation are defined as actions. According to the learned policy, AISO could adaptively select a proper retrieval action to seek the missing evidence at each step, based on the collected evidence and the reformulated query, or directly output the answer when the evidence set is sufficient for the question. Experiments on SQuAD Open and HotpotQA fullwiki, which serve as single hop and multi hop open domain QA benchmarks, show that AISO outperforms all baseline methods with predefined strategies in terms of both retrieval and answer evaluations.


Experimental validation of fluid inertia models for a cylinder settling in a quiescent flow. The precise description of the motion of anisotropic particles in a flow rests on the understanding of the force and torque acting on them. Here, we study experimentally small, very elongated particles settling in a fluid at small Reynolds number. In our experiments, we can, to a very good approximation, relate the rate of rotation of cylindrical tungsten rods, of aspect ratios beta 8 and beta 16, settling in pure glycerol to the torque they are experiencing. This allows us to compare the measured torque with expressions obtained either in the slender rod limit, or in the case of spheroids. Both theories predict a simple angle dependence for the torque, which is found to capture very well the experimental results. Surprisingly, the slender rod approximation predicts much better the results for beta 8, than for beta 16. In the latter case, the expression obtained for a spheroid provides a better approximation. The translational dynamics is shown to be in qualitative agreement with the slender rod and spheroid models, the former one being found to represent better the experimental data.


The Law of Large Documents Understanding the Structure of Legal Contracts Using Visual Cues. Large, pre trained transformer models like BERT have achieved state of the art results on document understanding tasks, but most implementations can only consider 512 tokens at a time. For many real world applications, documents can be much longer, and the segmentation strategies typically used on longer documents miss out on document structure and contextual information, hurting their results on downstream tasks. In our work on legal agreements, we find that visual cues such as layout, style, and placement of text in a document are strong features that are crucial to achieving an acceptable level of accuracy on long documents. We measure the impact of incorporating such visual cues, obtained via computer vision methods, on the accuracy of document understanding tasks including document segmentation, entity extraction, and attribute classification. Our method of segmenting documents based on structural metadata out performs existing methods on four long document understanding tasks as measured on the Contract Understanding Atticus Dataset.


FedMM Saddle Point Optimization for Federated Adversarial Domain Adaptation. Federated adversary domain adaptation is a unique distributed minimax training task due to the prevalence of label imbalance among clients, with each client only seeing a subset of the classes of labels required to train a global model. To tackle this problem, we propose a distributed minimax optimizer referred to as FedMM, designed specifically for the federated adversary domain adaptation problem. It works well even in the extreme case where each client has different label classes and some clients only have unsupervised tasks. We prove that FedMM ensures convergence to a stationary point with domain shifted unsupervised data. On a variety of benchmark datasets, extensive experiments show that FedMM consistently achieves either significant communication savings or significant accuracy improvements over federated optimizers based on the gradient descent ascent (GDA) algorithm. When training from scratch, for example, it outperforms other GDA based federated average methods by around 20 in accuracy over the same communication rounds and it consistently outperforms when training from pre trained models with an accuracy improvement from 5.4 to 9 for different networks.


Demonstrating a single block 3D segmented plastic scintillator detector. Three dimensional finely grained plastic scintillator detectors bring many advantages in particle detectors, allowing a massive active target which enables a high precision tracking of interaction products, excellent calorimetry and a sub nanosecond time resolution. Whilst such detectors can be scaled up to several tonnes, as required by future neutrino experiments, a relatively long production time, where each single plastic scintillator element is independently manufactured and machined, together with potential challenges in the assembly, complicates their realisation. In this manuscript we propose a novel design for 3D granular scintillator detectors where O( 1 text cm 3 ) cubes are efficiently glued in a single block of scintillator after being produced via cast polymerization, which can enable rapid and cost efficient detector construction. This work could become particularly relevant for the detectors of the next generation long baseline neutrino oscillation experiments, such as DUNE, Hyper Kamiokande and ESSnuB.


Specialize and Fuse Pyramidal Output Representation for Semantic Segmentation. We present a novel pyramidal output representation to ensure parsimony with our "specialize and fuse" process for semantic segmentation. A pyramidal "output" representation consists of coarse to fine levels, where each level is "specialize" in a different class distribution (e.g., more stuff than things classes at coarser levels). Two types of pyramidal outputs (i.e., unity and semantic pyramid) are "fused" into the final semantic output, where the unity pyramid indicates unity cells (i.e., all pixels in such cell share the same semantic label). The process ensures parsimony by predicting a relatively small number of labels for unity cells (e.g., a large cell of grass) to build the final semantic output. In addition to the "output" representation, we design a coarse to fine contextual module to aggregate the "features" representation from different levels. We validate the effectiveness of each key module in our method through comprehensive ablation studies. Finally, our approach achieves state of the art performance on three widely used semantic segmentation datasets ADE20K, COCO Stuff, and Pascal Context.


Type Prediction Systems. Inferring semantic types for entity mentions within text documents is an important asset for many downstream NLP tasks, such as Semantic Role Labelling, Entity Disambiguation, Knowledge Base Question Answering, etc. Prior works have mostly focused on supervised solutions that generally operate on relatively small to medium sized type systems. In this work, we describe two systems aimed at predicting type information for the following two tasks, namely, a TypeSuggest module, an unsupervised system designed to predict types for a set of user entered query terms, and an Answer Type prediction module, that provides a solution for the task of determining the correct type of the answer expected to a given query. Our systems generalize to arbitrary type systems of any sizes, thereby making it a highly appealing solution to extract type information at any granularity.


Many neighborly spheres. The result of Padrol asserts that for every d geq 4 , there exist 2 Omega(n log n) distinct combinatorial types of lfloor d 2 rfloor neighborly simplicial (d 1) spheres with n vertices. We present a construction showing that for every d geq 5 , there are at least 2 Omega(n lfloor (d 1) 2 rfloor ) such types.


The False COVID 19 Narratives That Keep Being Debunked A Spatiotemporal Analysis. The onset of the Coronavirus disease 2019 (COVID 19) pandemic instigated a global infodemic that has brought unprecedented challenges for society as a whole. During this time, a number of manual fact checking initiatives have emerged to alleviate the spread of dis mis information. This study is about COVID 19 debunks published in multiple languages by different fact checking organisations, sometimes as far as several months apart, despite the fact that the claim has already been fact checked before. The spatiotemporal analysis reveals that similar or nearly duplicate false COVID 19 narratives have been spreading in multifarious modalities on various social media platforms in different countries. We also find that misinformation involving general medical advice has spread across multiple countries and hence has the highest proportion of false COVID 19 narratives that keep being debunked. Furthermore, as manual fact checking is an onerous task in itself, therefore debunking similar claims recurrently is leading to a waste of resources. To this end, we propound the idea of the inclusion of multilingual debunk search in the fact checking pipeline.


On Designing Good Representation Learning Models. The goal of representation learning is different from the ultimate objective of machine learning such as decision making, it is therefore very difficult to establish clear and direct objectives for training representation learning models. It has been argued that a good representation should disentangle the underlying variation factors, yet how to translate this into training objectives remains unknown. This paper presents an attempt to establish direct training criterions and design principles for developing good representation learning models. We propose that a good representation learning model should be maximally expressive, i.e., capable of distinguishing the maximum number of input configurations. We formally define expressiveness and introduce the maximum expressiveness (MEXS) theorem of a general learning model. We propose to train a model by maximizing its expressiveness while at the same time incorporating general priors such as model smoothness. We present a conscience competitive learning algorithm which encourages the model to reach its MEXS whilst at the same time adheres to model smoothness prior. We also introduce a label consistent training (LCT) technique to boost model smoothness by encouraging it to assign consistent labels to similar samples. We present extensive experimental results to show that our method can indeed design representation learning models capable of developing representations that are as good as or better than state of the art. We also show that our technique is computationally efficient, robust against different parameter settings and can work effectively on a variety of datasets. Code available at https github.com qlilx odgrlm.git


Uniform Sobolev estimates in mathbb R n involving singular potentials. We generalize the Stein Tomas 17 L 2 restricition theorem and the uniform Sobolev estimates of Kenig, Ruiz and the second author 11 by allowing critically singular potential. We also obtain Strichartz estimates for Schr "odinger and wave operators with such potentials. Due to the fact that there may be nontrivial eigenfunctions we are required to make certain spectral assumptions, such as assuming that the solutions only involve sufficiently large frequencies.


Patterns for Blockchain Based Payment Applications. As the killer application of blockchain technology, blockchain based payments have attracted extensive attention ranging from hobbyists to corporates to regulatory bodies. Blockchain facilitates fast, secure, and cross border payments without the need for intermediaries such as banks. Because blockchain technology is still emerging, systematically organised knowledge providing a holistic and comprehensive view on designing payment applications that use blockchain is yet to be established. If such knowledge could be established in the form of a set of blockchain specific patterns, architects could use those patterns in designing a payment application that leverages blockchain. Therefore, in this paper, we first identify a token's lifecycle and then present 12 patterns that cover critical aspects in enabling the state transitions of a token in blockchain based payment applications. The lifecycle and the annotated patterns provide a payment focused systematic view of system interactions and a guide to effective use of the patterns.


Representation Learning of Reconstructed Graphs Using Random Walk Graph Convolutional Network. Graphs are often used to organize data because of their simple topological structure, and therefore play a key role in machine learning. And it turns out that the low dimensional embedded representation obtained by graph representation learning are extremely useful in various typical tasks, such as node classification, content recommendation and link prediction. However, the existing methods mostly start from the microstructure (i.e., the edges) in the graph, ignoring the mesoscopic structure (high order local structure). Here, we propose wGCN a novel framework that utilizes random walk to obtain the node specific mesoscopic structures of the graph, and utilizes these mesoscopic structures to reconstruct the graph And organize the characteristic information of the nodes. Our method can effectively generate node embeddings for previously unseen data, which has been proven in a series of experiments conducted on citation networks and social networks (our method has advantages over baseline methods). We believe that combining high order local structural information can more efficiently explore the potential of the network, which will greatly improve the learning efficiency of graph neural network and promote the establishment of new learning models.


Distilled Domain Randomization. Deep reinforcement learning is an effective tool to learn robot control policies from scratch. However, these methods are notorious for the enormous amount of required training data which is prohibitively expensive to collect on real robots. A highly popular alternative is to learn from simulations, allowing to generate the data much faster, safer, and cheaper. Since all simulators are mere models of reality, there are inevitable differences between the simulated and the real data, often referenced as the 'reality gap'. To bridge this gap, many approaches learn one policy from a distribution over simulators. In this paper, we propose to combine reinforcement learning from randomized physics simulations with policy distillation. Our algorithm, called Distilled Domain Randomization (DiDoR), distills so called teacher policies, which are experts on domains that have been sampled initially, into a student policy that is later deployed. This way, DiDoR learns controllers which transfer directly from simulation to reality, i.e., without requiring data from the target domain. We compare DiDoR against three baselines in three sim to sim as well as two sim to real experiments. Our results show that the target domain performance of policies trained with DiDoR is en par or better than the baselines'. Moreover, our approach neither increases the required memory capacity nor the time to compute an action, which may well be a point of failure for successfully deploying the learned controller.


Transformers with Competitive Ensembles of Independent Mechanisms. An important development in deep learning from the earliest MLPs has been a move towards architectures with structural inductive biases which enable the model to keep distinct sources of information and routes of processing well separated. This structure is linked to the notion of independent mechanisms from the causality literature, in which a mechanism is able to retain the same processing as irrelevant aspects of the world are changed. For example, convnets enable separation over positions, while attention based architectures (especially Transformers) learn which combination of positions to process dynamically. In this work we explore a way in which the Transformer architecture is deficient it represents each position with a large monolithic hidden representation and a single set of parameters which are applied over the entire hidden representation. This potentially throws unrelated sources of information together, and limits the Transformer's ability to capture independent mechanisms. To address this, we propose Transformers with Independent Mechanisms (TIM), a new Transformer layer which divides the hidden representation and parameters into multiple mechanisms, which only exchange information through attention. Additionally, we propose a competition mechanism which encourages these mechanisms to specialize over time steps, and thus be more independent. We study TIM on a large scale BERT model, on the Image Transformer, and on speech enhancement and find evidence for semantically meaningful specialization as well as improved performance.


Affine Deligne Lusztig Varieties and Quantum Bruhat Graph. In this paper, we consider affine Deligne Lusztig varieties X w(b) and their certain union X( mu,b) inside the affine flag variety of a reductive group. Several important results in the study of affine Deligne Lusztig varieties have been established under the so called superregularity hypothesis. Such results include a description of generic Newton points in Iwahori double cosets of loop groups, covering relation in associated Iwahori Weyl group and dimension formula for X( mu,b) . We show that one can considerably weaken the superregularity hypothesis and sometimes completely eliminate it, thus strengthening these existing results.


Symmetry and Spectral Invariance for Topologically Graded C Algebras and Partial Action Systems. A discrete group G is called rigidly symmetric if the projective tensor product between the convolution algebra ell 1( G) and any C algebra A is symmetric. We show that in each topologically graded C algebra over a rigidly symmetric group there is a ell 1 type symmetric Banach algebra, which is inverse closed in the C algebra. This includes new general classes, as algebras admitting dual actions and partial crossed products. Results including convolution dominated kernels, inverse closedness with respect with ideals or weighted versions of the ell 1 decay are included. Various concrete examples are presented.


Multiplicative finite embeddability vs divisibility of ultrafilters. We continue the exploration of various aspects of divisibility of ultrafilters, adding one more relation to the picture multiplicative finite embeddability. We show that it lies between divisibility relations mid M and widetilde mid . The set of its minimal elements proves to be very rich, and the widetilde mid hierarchy is used to get a better intuition of this richness. We find the place of the set of widetilde mid maximal ultrafilters among some known families of ultrafilters. Finally, we introduce new notions of largeness of subsets of mathbb N , and compare it to other such notions, important for infinite combinatorics and topological dynamics.


Do female physics students benefit from informal physics programs they facilitate?. Gender bias, reduced sense of belonging, and lower physics self efficacy are among the challenges faced by female students who choose to study physics. Prior studies focusing on this underrepresented group have examined the experiences and impacts of formal educational settings, leaving the impact of informal physics programs as a relatively overlooked area. Existing research on the impact of informal physics programs indicates that student facilitators, who help run the programs, can experience positive impacts on their learning and sense of community beyond the formal setting of a classroom or laboratory. In this study we took a first step, narrowing our focus to explore the relation between facilitation of informal physics programs and female students' physics identity, persistence, mindset, and worldview. We analyzed survey responses (32) and interviews (11) collected from undergraduate and graduate female students at a large, land grant university. Our results, based on self reported data, showed a statistically significant shift in confidence of choice of major after facilitating informal physics programs. Analysis of interviews indicated a positive effect of facilitation of informal programs on female student interest and motivation with regards to the field of physics, improved performance and competence beliefs, and the development of characteristics indicative of a growth mindset. A semantic network analysis showed statistically significant interdependencies between positive persistence and constructs including growth mindset, important early undergraduate experiences, gender stereotype threat, external recognition, and confidence.


Instance based Label Smoothing For Better Calibrated Classification Networks. Label smoothing is widely used in deep neural networks for multi class classification. While it enhances model generalization and reduces overconfidence by aiming to lower the probability for the predicted class, it distorts the predicted probabilities of other classes resulting in poor class wise calibration. Another method for enhancing model generalization is self distillation where the predictions of a teacher network trained with one hot labels are used as the target for training a student network. We take inspiration from both label smoothing and self distillation and propose two novel instance based label smoothing approaches, where a teacher network trained with hard one hot labels is used to determine the amount of per class smoothness applied to each instance. The assigned smoothing factor is non uniformly distributed along with the classes according to their similarity with the actual class. Our methods show better generalization and calibration over standard label smoothing on various deep neural architectures and image classification datasets.


Neo Generalizing Confusion Matrix Visualization to Hierarchical and Multi Output Labels. The confusion matrix, a ubiquitous visualization for helping people evaluate machine learning models, is a tabular layout that compares predicted class labels against actual class labels over all data instances. We conduct formative research with machine learning practitioners at Apple and find that conventional confusion matrices do not support more complex data structures found in modern day applications, such as hierarchical and multi output labels. To express such variations of confusion matrices, we design an algebra that models confusion matrices as probability distributions. Based on this algebra, we develop Neo, a visual analytics system that enables practitioners to flexibly author and interact with hierarchical and multi output confusion matrices, visualize derived metrics, renormalize confusions, and share matrix specifications. Finally, we demonstrate Neo's utility with three model evaluation scenarios that help people better understand model performance and reveal hidden confusions.


Mind the Gap Cross Lingual Information Retrieval with Hierarchical Knowledge Enhancement. Cross Lingual Information Retrieval (CLIR) aims to rank the documents written in a language different from the user's query. The intrinsic gap between different languages is an essential challenge for CLIR. In this paper, we introduce the multilingual knowledge graph (KG) to the CLIR task due to the sufficient information of entities in multiple languages. It is regarded as a "silver bullet" to simultaneously perform explicit alignment between queries and documents and also broaden the representations of queries. And we propose a model named CLIR with hierarchical knowledge enhancement (HIKE) for our task. The proposed model encodes the textual information in queries, documents and the KG with multilingual BERT, and incorporates the KG information in the query document matching process with a hierarchical information fusion mechanism. Particularly, HIKE first integrates the entities and their neighborhood in KG into query representations with a knowledge level fusion, then combines the knowledge from both source and target languages to further mitigate the linguistic gap with a language level fusion. Finally, experimental results demonstrate that HIKE achieves substantial improvements over state of the art competitors.


Extreme events in a polar warming scenario a laboratory perspective. We report on a set of laboratory experiments to investigate the effect of Arctic warming on the amplitude and drift speed of the mid latitude jet stream. Our results show that a progressive decrease of the meridional temperature difference 1) slows down the eastward propagation of the jet stream, 2) complexifies its structure, and 3) increases the frequency of extreme events. Extreme events and temperature variability show a clear trend in relation to the Arctic warming only at latitudes influenced by the jet stream, whilst such trend reverses in the equatorial region south of the subtropical jet. Despite missing land sea contrast in the laboratory model, we find similar trends of temperature variability and extreme events in the experimental data and the National Centers for Environmental Prediction (NCEP) reanalysis data. Moreover, our data qualitatively confirm the decrease in temperature variability due to the meridional temperature gradient weakening (which has been proposed recently based on proxy data). Probability distributions are weakly sensitive to changes in the temperature gradient, which can be explained by recent findings using quasigeostrophic models.


Ackermann's Function in Iterative Form A Proof Assistant Experiment. Ackermann's function can be expressed using an iterative algorithm, which essentially takes the form of a term rewriting system. Although the termination of this algorithm is far from obvious, its equivalence to the traditional recursive formulation and therefore its totality has a simple proof in Isabelle HOL. This is a small example of formalising mathematics using a proof assistant, with a focus on the treatment of difficult recursions.


Single inertial particle statistics in turbulent flows from Lagrangian velocity models. We present the extension of a modeling technique for Lagrangian tracer particles B. Viggiano et al., J. Fluid Mech.(2020), vol. 900, A27 which accounts for the effects of particle inertia. Thereby, the particle velocity for several Stokes numbers is modeled directly by a multi layered Ornstein Uhlenbeck process and a comparison of key statistical quantities (second order velocity structure function, acceleration correlation function, and root mean square acceleration) to expressions derived from Batchelor's model as well as to direct numerical simulations (DNS) is performed. In both approaches, Stokes' drag is treated by an approximate linear filter'' which replaces the particle position entering the fluid velocity field by the corresponding ideal tracer position. Effects of preferential concentration of inertial particles are taken into account in terms of an effective Stokes number that is determined from the zero crossing of the acceleration correlation function from DNS. This approximation thus allows the modeling of inertial particle statistics through stochastic methods and models for the Lagrangian velocity the particle velocity is effectively decoupled from the particle position. In contrast to the ordinary filtering technique Cencini et al., J. Turbul. (2006), 7, N36 , our method captures the effects of preferential concentration of particles at low Stokes numbers which manifest themselves for instance by a sharp decrease of the acceleration variance for increasing Stokes numbers.


Searching for Search Errors in Neural Morphological Inflection. Neural sequence to sequence models are currently the predominant choice for language generation tasks. Yet, on word level tasks, exact inference of these models reveals the empty string is often the global optimum. Prior works have speculated this phenomenon is a result of the inadequacy of neural models for language generation. However, in the case of morphological inflection, we find that the empty string is almost never the most probable solution under the model. Further, greedy search often finds the global optimum. These observations suggest that the poor calibration of many neural models may stem from characteristics of a specific subset of tasks rather than general ill suitedness of such models for language generation.


Filtered formal groups, Cartier duality, and derived algebraic geometry. We develop a notion of formal groups in the filtered setting and describe a duality relating these to a specified class of filtered Hopf algebras. We then study a deformation to the normal cone construction in the setting of derived algebraic geometry. Applied to the unit section of a formal group widehat mathbb G , this provides a mathbb G m equivariant degeneration of widehat mathbb G to its tangent Lie algebra. We prove a unicity result on complete filtrations, which, in particular, identifies the resulting filtration on the coordinate algebra of this deformation with the adic filtration on the coordinate algebra of widehat mathbb G . We use this in a special case, together with the aforementioned notion of Cartier duality, to recover the filtration on the filtered circle of MRT19 . Finally, we investigate some properties of widehat mathbb G Hochschild homology set out in loc. cit., and describe "lifts" of these invariants to the setting of spectral algebraic geometry.


Most(?) theories have Borel complete reducts. We prove that many seemingly simple theories have Borel complete reducts. Specifically, if a countable theory has uncountably many complete 1 types, then it has a Borel complete reduct. Similarly, if Th(M) is not small, then M eq has a Borel complete reduct, and if a theory T is not omega stable, then the elementary diagram of some countable model of T has a Borel complete reduct.


Dropout against Deep Leakage from Gradients. As the scale and size of the data increases significantly nowadays, federal learning (Bonawitz et al. 2019 ) for high performance computing and machine learning has been much more important than ever beforeAbadi et al. 2016 . People used to believe that sharing gradients seems to be safe to conceal the local training data during the training stage. However, Zhu et al. 2019 demonstrated that it was possible to recover raw data from the model training data by detecting gradients. They use generated random dummy data and minimise the distance between them and real data. Zhao et al. 2020 pushes the convergence algorithm even further. By replacing the original loss function with cross entropy loss, they achieve better fidelity threshold. In this paper, we propose using an additional dropout (Srivastava et al. 2014 ) layer before feeding the data to the classifier. It is very effective in preventing leakage of raw data, as the training data cannot converge to a small RMSE even after 5,800 epochs with dropout rate set to 0.5.


Tableaux for Free Logics with Descriptions. The paper provides a tableau approach to definite descriptions. We focus on several formalizations of the so called minimal free description theory (MFD) usually formulated axiomatically in the setting of free logic. We consider five analytic tableau systems corresponding to different kinds of free logic, including the logic of definedness applied in computer science and constructive mathematics for dealing with partial functions (here called negative quasi free logic). The tableau systems formalise MFD based on PFL (positive free logic), NFL (negative free logic), PQFL and NQFL (the quasi free counterparts of the former ones). Also the logic NQFLm is taken into account, which is equivalent to NQFL, but whose language does not comprise the existence predicate. It is shown that all tableaux are sound and complete with respect to the semantics of these logics.


One dimensional symmetry of positive bounded solutions to the nonlinear Schr " o dinger equation in the half space. We are concerned with the half space Dirichlet problem begin array ll Delta v v v p 1 v textrm in mathbb R N , v c textrm on partial mathbb R N , lim x N to infty v(x',x N) 0 textrm uniformly in x' in mathbb R N 1 , end array where mathbb R N x in mathbb R N x N 0 for some N geq 2 , and p 1 , c 0 are constants. It was shown recently by Fernandez and Weth Math. Ann. (2021) that there exists an explicit number c p in (1, sqrt e ) , depending only on p , such that for 0 c c p there are infinitely many bounded positive solutions, whereas, for c c p there are no bounded positive solutions. If N 2, 3 , we show that in the case c c p there is no other bounded positive solution besides the one dimensional one.


RB CCR Radial Based Combined Cleaning and Resampling algorithm for imbalanced data classification. Real world classification domains, such as medicine, health and safety, and finance, often exhibit imbalanced class priors and have asynchronous misclassification costs. In such cases, the classification model must achieve a high recall without significantly impacting precision. Resampling the training data is the standard approach to improving classification performance on imbalanced binary data. However, the state of the art methods ignore the local joint distribution of the data or correct it as a post processing step. This can causes sub optimal shifts in the training distribution, particularly when the target data distribution is complex. In this paper, we propose Radial Based Combined Cleaning and Resampling (RB CCR). RB CCR utilizes the concept of class potential to refine the energy based resampling approach of CCR. In particular, RB CCR exploits the class potential to accurately locate sub regions of the data space for synthetic oversampling. The category sub region for oversampling can be specified as an input parameter to meet domain specific needs or be automatically selected via cross validation. Our 5 times2 cross validated results on 57 benchmark binary datasets with 9 classifiers show that RB CCR achieves a better precision recall trade off than CCR and generally out performs the state of the art resampling methods in terms of AUC and G mean.


"It may be a pain in the backside but..." Insights into the impact of GDPR on business after three years. The General Data Protection Regulation (GDPR) came into effect in May 2018 and is designed to safeguard EU citizens' data privacy. The benefits of the regulation to consumers' rights and to regulators' powers are well known. The benefits to regulated businesses are less obvious and under researched. The aim of this study is to investigate if GDPR is all pain and no gain for business. Using semi structured interviews, we survey 14 C level executives responsible for business, finance, marketing, legal and technology drawn from six small, medium and large companies in the UK and Ireland. We find the threat of fines has focused the corporate mind and made business more privacy aware. Organisationally, it has created new power bases within companies to advocate GDPR. It has forced companies, in varying degrees, to modernise their platforms and indirectly benefited them with better risk management processes, information security infrastructure and up to date customer databases. Compliance, for some, is used as a reputational signal of trustworthiness. We find many implementation challenges remain. New business development and intra company communication is more constrained. Regulation has increased costs and internal bureaucracy. Grey areas remain due to a lack of case law. Disgruntled customers and ex employees weaponise Subject Access Requests (SAR) as a tool of retaliation. Small businesses see GDPR as overkill and overwhelming. We conclude GDPR may be regarded as a pain by business but it has made it more careful with data. We recommend the EU consider tailoring a version of the regulation that is better suited to SMEs and modifying the messaging to be more positive whilst still exploiting news of fines to reinforce corporate data discipline.


Boron nitride nanotube precursor formation during high temperature synthesis kinetic and thermodynamic modelling. We performed integrated modelling of the chemical pathways of formation for boron nitride nanotube (BNNT) precursors during high temperature synthesis in a B N2 mixture. Modelling includes quantum chemistry, quantum classical molecular dynamics, thermodynamic, and kinetic approaches. It is shown that BN compounds are formed in the interaction of N2 molecules with small boron clusters (N2 molecule fixation) rather than with less reactive liquid boron. We demonstrate that the transformation and consumption of liquid boron proceeds through the evaporation of clusters, Bm with m less than or equal to 5 and their subsequent conversion into BmNn chains. The production of such chains is crucial to the growth of BNNTs because these chains form the building blocks of bigger and longer BN chains and rings, which are themselves the building blocks of fullborenes and BNNTs. Moreover, kinetic modelling revealed that B4N4 and B5N4 species play a major role in the N2 molecule fixation process. The formation of these species via reactions with B4 and B5 clusters is not adequately described under the assumption of thermodynamic equilibrium because the accumulation of both B4N4 and B5N4 depends on the background gas pressure and the gas cooling rate. Long BN chains and rings, which are precursors of the fullborene and BNNT growth, form via self assembly of component B4N4 and B5N4. Our modelling results (particularly the increased densities of B4N4 and B5N4 species at higher gas pressures) explain the experimentally observed effect of gas pressure on the yield of high quality BNNTs. The catalytic role of hydrogen was also studied it is shown that HBNH molecules can be the main precursor of BNNT synthesis in the presence of hydrogen.


Minimal pairs, minimal fields and implicit constant fields. Minimal pairs of definition were introduced by Alexandru, Popescu and Zaharescu to study residue transcendental extensions. In this paper we obtain analogous results in the value transcendental case. We introduce the notion of minimal fields of definition for valuation transcendental extensions and show that they share some common ramification theoretic properties. The connection between minimal fields of definition and implicit constant fields is also investigated. Further, we explore the relationship between valuation transcendental extensions and pseudo Cauchy sequences.


BATTPOWER Application Large Scale Integration of EVs in an Active Distribution Grid A Norwegian Case Study. In this paper, we introduce an application of a high performance MultiPeriod AC Optimal Power Flow (MPOPF) solver, called "BATTPOWER", to simulate active distribution grids for a near future scenario. A large scale Norwegian distribution grid along with a large population of Electric Vehicles (EV) are here taken as the case study. We suggest and analyse three operational strategies (in terms of control of charge scheduling fleet of EV) for the Distribution System Operator (DSO) (a) uncoordinated dumb charge scheduling, (b) coordinated charge scheduling with the objective of energy cost minimisation without operational constraints of the grid, and (c) coordinated charge scheduling with the objective of energy cost minimisation along with the operational constraints of the grid. The results demonstrate that the uncoordinated charging would lead to 1) overloading of lines and transformers when the share of EVs is above 20 , and 2) higher operational costs than the proposed control strategies of (b) and (c). In strategy (b) operational line transformer limits are violated when the populations of EVs are growing above 36 . This implies that current market design must be altered to allow active control of a large proportion of DERs within grid operational limits to achieve cost minimization at system level. To our knowledge, the work presented in this paper is the first ever attempt to do a comprehensive analysis of the impact of EV charging demand on a real Norwegian distribution grid. Moreover, the inference of the analysis says that the Norwegian distribution networks are more prone to congestion problems than the voltage problems for the EV demand which includes a smart charging scheme accounting for grid conditions.


Fundamental Theory of the Evolution Force Gene Engineering Utilizing Synthetic Evolution Artificial Intelligence. The effects of the evolution force are observable in nature at all structural levels ranging from small molecular systems to conversely enormous biospheric systems. However, the evolution force and work associated with formation of biological structures has yet to be described mathematically or theoretically. In addressing the conundrum, we consider evolution from a unique perspective and in doing so introduce the Fundamental Theory of the Evolution Force, FTEF. Herein, we prove FTEF by proof of concept using a synthetic evolution artificial intelligence to engineer 14 3 3 zeta docking proteins. Synthetic genes were engineered by transforming 14 3 3 zeta sequences into time based DNA codes that served as templates for random DNA hybridizations and genetic assembly. Application of time based DNA codes allowed us to fast forward evolution, while damping the effect of point mutations. Notably, SYN AI engineered a set of three architecturally conserved docking proteins that retained motion and vibrational dynamics of native Bos taurus 14 3 3 zeta .


The spectrum of the Laplacian and volume growth of proper minimal submanifolds. We give upper bounds for the bottom of the essential spectrum of properly immersed minimal submanifolds of mathbb R n in terms of their volume growth. Our result improves the extrinsic version of Brook's essential spectrum estimate given by Ilias Nelli Soret in cite Cor.3 ins .


FedLGA Towards System Heterogeneity of Federated Learning via Local Gradient Approximation. Federated Learning (FL) is a decentralized machine learning architecture, which leverages a large number of remote devices to learn a joint model with distributed training data. However, the system heterogeneity is one major challenge in a FL network to achieve robust distributed learning performance, which comes from two aspects i) device heterogeneity due to the diverse computational capacity among devices ii) data heterogeneity due to the non identically distributed data across the network. Prior studies addressing the heterogeneous FL issue, e.g., FedProx, lack formalization and it remains an open problem. This work first formalizes the system heterogeneous FL problem and proposes a new algorithm, called FedLGA, to address this problem by bridging the divergence of local model updates via gradient approximation. To achieve this, FedLGA provides an alternated Hessian estimation method, which only requires extra linear complexity on the aggregator. Theoretically, we show that with a device heterogeneous ratio rho , FedLGA achieves convergence rates on non i.i.d. distributed FL training data for the non convex optimization problems with mathcal O left( frac (1 rho) sqrt ENT frac 1 T right) and mathcal O left( frac (1 rho) sqrt E sqrt TK frac 1 T right) for full and partial device participation respectively, where E is the number of local learning epoch, T is the number of total communication round, N is the total device number and K is the number of selected device in one communication round under partially participation scheme. The results of comprehensive experiments on multiple datasets show that FedLGA outperforms current FL methods against the system heterogeneity.


Duality and tangles of set separations. Applications of tangles of connectivity systems suggest a duality between these, in which for two sets X and Y ! the elements x of X map to subsets Y x of Y ! , and the elements y of Y ! map to subsets X y of X , so that x in X y if and only if y in Y x for all x in X and y in Y ! . We explore this duality, and relate the tangles arising from the dual systems to each other.


An Attract Repel Decomposition of Undirected Networks. Dot product latent space embedding is a common form of representation learning in undirected graphs (e.g. social networks, co occurrence networks). We show that such models have problems dealing with 'intransitive' situations where A is linked to B, B is linked to C but A is not linked to C. Such situations occur in social networks when opposites attract (heterophily) and in co occurrence networks when there are substitute nodes (e.g. the presence of Pepsi or Coke, but rarely both, in otherwise similar purchase baskets). We present a simple expansion which we call the attract repel (AR) decomposition a set of latent attributes on which similar nodes attract and another set of latent attributes on which similar nodes repel. We demonstrate the AR decomposition in real social networks and show that it can be used to measure the amount of latent homophily and heterophily. In addition, it can be applied to co occurrence networks to discover roles in teams and find substitutable ingredients in recipes.


LineCounter Learning Handwritten Text Line Segmentation by Counting. Handwritten Text Line Segmentation (HTLS) is a low level but important task for many higher level document processing tasks like handwritten text recognition. It is often formulated in terms of semantic segmentation or object detection in deep learning. However, both formulations have serious shortcomings. The former requires heavy post processing of splitting merging adjacent segments, while the latter may fail on dense or curved texts. In this paper, we propose a novel Line Counting formulation for HTLS that involves counting the number of text lines from the top at every pixel location. This formulation helps learn an end to end HTLS solution that directly predicts per pixel line number for a given document image. Furthermore, we propose a deep neural network (DNN) model LineCounter to perform HTLS through the Line Counting formulation. Our extensive experiments on the three public datasets (ICDAR2013 HSC, HIT MW, and VML AHTE) demonstrate that LineCounter outperforms state of the art HTLS approaches. Source code is available at https github.com Leedeng Line Counter.


Ultrafast Internal Conversion Dynamics Through the on the fly Simulation of Transient Absorption Pump Probe Spectra with Different Electronic Structure Methods. The ultrafast nonadiabatic internal conversion in azomethane is explored by the on the fly trajectory surface hopping simulations of photoinduced dynamics and femtosecond transient absorption (TA) pump probe (PP) spectra at three electronic structure theory levels, OM2 MRCI, SA CASSCF, and XMS CASPT2. All these dynamics simulations predict ultrafast internal conversion. On the one hand, the OM2 MRCI and SA CASSCF methods yield similar excited state dynamics, while the XMS CASPT2 method predicts a much slower population decay. On the other hand, the TA PP signals simulated at the SA CASSCF and XMS CASPT2 levels show the similar spectral features, particularly for the similar stimulated emission contributions, while the OM2 MRCI signals are quite different. This demonstrates that the nonadiabatic population dynamics and time resolved stimulated emission signals may reflect different aspects of photoinduced processes. The combination of the dynamical and spectral simulations definitely provides more accurate and detailed information which sheds light on the microscopic mechanisms of photophysical and photochemical processes.


A Constraint Handling Approach with Guaranteed Feasibility for Surrogate Based Optimization. Gradient free optimization methods, such as surrogate based optimization (SBO) methods, and genetic (GAs), or evolutionary (EAs) algorithms have gained popularity in the field of constrained optimization of expensive black box functions. However, constraint handling methods, by both classes of solvers, do not usually guarantee strictly feasible candidates during optimization. This can become an issue in applied engineering problems where design variables must remain feasible for simulations to not fail. We propose a constraint handling method for computationally inexpensive constraint functions which guarantees strictly feasible candidates when using a surrogate based optimizer. We compare our method to other SBO, GA EA and gradient based algorithms on two (relatively simple and relatively hard) analytical test functions, and an applied fully resolved Computational Fluid Dynamics (CFD) problem concerned with optimization of an undulatory swimming of a fish like body, and show that the proposed algorithm shows favorable results while guaranteeing feasible candidates.


Unsupervised Video Person Re identification via Noise and Hard frame Aware Clustering. Unsupervised video based person re identification (re ID) methods extract richer features from video tracklets than image based ones. The state of the art methods utilize clustering to obtain pseudo labels and train the models iteratively. However, they underestimate the influence of two kinds of frames in the tracklet 1) noise frames caused by detection errors or heavy occlusions exist in the tracklet, which may be allocated with unreliable labels during clustering 2) the tracklet also contains hard frames caused by pose changes or partial occlusions, which are difficult to distinguish but informative. This paper proposes a Noise and Hard frame Aware Clustering (NHAC) method. NHAC consists of a graph trimming module and a node re sampling module. The graph trimming module obtains stable graphs by removing noise frame nodes to improve the clustering accuracy. The node re sampling module enhances the training of hard frame nodes to learn rich tracklet information. Experiments conducted on two video based datasets demonstrate the effectiveness of the proposed NHAC under the unsupervised re ID setting.


VAC CNN A Visual Analytics System for Comparative Studies of Deep Convolutional Neural Networks. The rapid development of Convolutional Neural Networks (CNNs) in recent years has triggered significant breakthroughs in many machine learning (ML) applications. The ability to understand and compare various CNN models available is thus essential. The conventional approach with visualizing each model's quantitative features, such as classification accuracy and computational complexity, is not sufficient for a deeper understanding and comparison of the behaviors of different models. Moreover, most of the existing tools for assessing CNN behaviors only support comparison between two models and lack the flexibility of customizing the analysis tasks according to user needs. This paper presents a visual analytics system, VAC CNN (Visual Analytics for Comparing CNNs), that supports the in depth inspection of a single CNN model as well as comparative studies of two or more models. The ability to compare a larger number of (e.g., tens of) models especially distinguishes our system from previous ones. With a carefully designed model visualization and explaining support, VAC CNN facilitates a highly interactive workflow that promptly presents both quantitative and qualitative information at each analysis stage. We demonstrate VAC CNN's effectiveness for assisting novice ML practitioners in evaluating and comparing multiple CNN models through two use cases and one preliminary evaluation study using the image classification tasks on the ImageNet dataset.


Powers of componentwise linear ideals The Herzog Hibi Ohsugi Conjecture and related problems. In 1999 Herzog and Hibi introduced componentwise linear ideals. A homogeneous ideal I is componentwise linear if for all non negative integers d , the ideal generated by the homogeneous elements of degree d in I has a linear resolution. For square free monomial ideals, componentwise linearity is related via Alexander duality to the property of being sequentially Cohen Macaulay for the corresponding simplicial complexes. In general, the property of being componentwise linear is not preserved by taking powers. In 2011, Herzog, Hibi, and Ohsugi conjectured that if I is the cover ideal of a chordal graph, then I s is componentwise linear for all s geq 1 . We survey some of the basic properties of componentwise linear ideals, and then specialize to the progress on the Herzog Hibi Ohsugi conjecture during the last decade. We also survey the related problem of determining when the symbolic powers of a cover ideal are componentwise linear.


On Channel Reciprocity in Reconfigurable Intelligent Surface Assisted Wireless Network. Channel reciprocity greatly facilitates downlink precoding in time division duplexing (TDD) multiple input multiple output (MIMO) communications without the need for channel state information (CSI) feedback. Recently, reconfigurable intelligent surfaces (RISs) emerge as a promising technology to enhance the performance of future wireless networks. However, since the artificial electromagnetic characteristics of RISs do not strictly follow the normal laws of nature, it brings up a question does the channel reciprocity hold in RIS assisted TDD wireless networks? After briefly reviewing the reciprocity theorem, in this article, we show that there still exists channel reciprocity for RIS assisted wireless networks satisfying certain conditions. We also experimentally demonstrate the reciprocity at the sub 6 GHz and the millimeter wave frequency bands by using two fabricated RISs. Furthermore, we introduce several RIS assisted approaches to realizing nonreciprocal channels. Finally, potential opportunities brought by reciprocal nonreciprocal RISs and future research directions are outlined.


Modified DDPG car following model with a real world human driving experience with CARLA simulator. In the autonomous driving field, fusion of human knowledge into Deep Reinforcement Learning (DRL) is often based on the human demonstration recorded in a simulated environment. This limits the generalization and the feasibility of application in real world traffic. We propose a two stage DRL method to train a car following agent, that modifies the policy by leveraging the real world human driving experience and achieves performance superior to the pure DRL agent. Training a DRL agent is done within CARLA framework with Robot Operating System (ROS). For evaluation, we designed different driving scenarios to compare the proposed two stage DRL car following agent with other agents. After extracting the "good" behavior from the human driver, the agent becomes more efficient and reasonable, which makes this autonomous agent more suitable for Human Robot Interaction (HRI) traffic.


The spanning k trees, perfect matchings and spectral radius of graphs. A k tree is a spanning tree with every vertex of degree at most k . In this paper, we provide some sufficient conditions, in terms of the (adjacency and signless Laplacian) spectral radius, for the existence of a k tree in a connected graph of order n , and a perfect matching in a balanced bipartite graph of order 2n with minimum degree delta , respectively.


Geodesic squared exponential kernel for non rigid shape registration. This work addresses the problem of non rigid registration of 3D scans, which is at the core of shape modeling techniques. Firstly, we propose a new kernel based on geodesic distances for the Gaussian Process Morphable Models (GPMMs) framework. The use of geodesic distances into the kernel makes it more adapted to the topological and geometric characteristics of the surface and leads to more realistic deformations around holes and curved areas. Since the kernel possesses hyperparameters we have optimized them for the task of face registration on the FaceWarehouse dataset. We show that the Geodesic squared exponential kernel performs significantly better than state of the art kernels for the task of face registration on all the 20 expressions of the FaceWarehouse dataset. Secondly, we propose a modification of the loss function used in the non rigid ICP registration algorithm, that allows to weight the correspondences according to the confidence given to them. As a use case, we show that we can make the registration more robust to outliers in the 3D scans, such as non skin parts.


End to End Dense Video Grounding via Parallel Regression. Video grounding aims to localize the corresponding video moment in an untrimmed video given a language query. Existing methods often address this task in an indirect way, by casting it as a proposal and match or fusion and detection problem. Solving these surrogate problems often requires sophisticated label assignment during training and hand crafted removal of near duplicate results. Meanwhile, existing works typically focus on sparse video grounding with a single sentence as input, which could result in ambiguous localization due to its unclear description. In this paper, we tackle a new problem of dense video grounding, by simultaneously localizing multiple moments with a paragraph as input. From a perspective on video grounding as language conditioned regression, we present an end to end parallel decoding paradigm by re purposing a Transformer alike architecture (PRVG). The key design in our PRVG is to use languages as queries, and directly regress the moment boundaries based on language modulated visual representations. Thanks to its simplicity in design, our PRVG framework can be applied in different testing schemes (sparse or dense grounding) and allows for efficient inference without any post processing technique. In addition, we devise a robust proposal level attention loss to guide the training of PRVG, which is invariant to moment duration and contributes to model convergence. We perform experiments on two video grounding benchmarks of ActivityNet Captions and TACoS, demonstrating that our PRVG can significantly outperform previous methods. We also perform in depth studies to investigate the effectiveness of parallel regression paradigm on video grounding.


Fusion FlowNet Energy Efficient Optical Flow Estimation using Sensor Fusion and Deep Fused Spiking Analog Network Architectures. Standard frame based cameras that sample light intensity frames are heavily impacted by motion blur for high speed motion and fail to perceive scene accurately when the dynamic range is high. Event based cameras, on the other hand, overcome these limitations by asynchronously detecting the variation in individual pixel intensities. However, event cameras only provide information about pixels in motion, leading to sparse data. Hence, estimating the overall dense behavior of pixels is difficult. To address such issues associated with the sensors, we present Fusion FlowNet, a sensor fusion framework for energy efficient optical flow estimation using both frame and event based sensors, leveraging their complementary characteristics. Our proposed network architecture is also a fusion of Spiking Neural Networks (SNNs) and Analog Neural Networks (ANNs) where each network is designed to simultaneously process asynchronous event streams and regular frame based images, respectively. Our network is end to end trained using unsupervised learning to avoid expensive video annotations. The method generalizes well across distinct environments (rapid motion and challenging lighting conditions) and demonstrates state of the art optical flow prediction on the Multi Vehicle Stereo Event Camera (MVSEC) dataset. Furthermore, our network offers substantial savings in terms of the number of network parameters and computational energy cost.


Asymptotic analysis and numerical computation of the Laplacian eigenvalues using the conformal mapping. We consider the Dirichlet and Neumann eigenvalues of the Laplacian for a simply connected, planar domain. The eigenvalues are the characteristic values of layer potential operators involving the Hankel function. First, we obtain an asymptotic formula for the Laplace eigenvalues with respect to the perturbation of the domain. The results are based on the Gohberg Sigal theory for operator valued functions. Second, we propose a numerical computation scheme to compute the Laplacian eigenvalues based on the matrix formulation of the layer potential operators with a geometric basis associated with the exterior conformal mapping of the domain. This provides a way to compute Laplace eigenvalues, lambda , by finding roots of polynomials in lambda and log lambda . We also derive a fully computable a priori error estimate with no assumption on the domain's convexity. This shows the relation between the domain's regularity and the convergence rate of the proposed method to compute Laplace eigenvalues.


Open domain question classification and completion in conversational information search. Searching for new information requires talking to the system. In this research, an Open domain Conversational information search system has been developed. This system has been implemented using the TREC CAsT 2019 track, which is one of the first attempts to build a framework in this area. According to the user's previous questions, the system firstly completes the question (using the first and the previous question in each turn) and then classifies it (based on the question words). This system extracts the related answers according to the rules of each question. In this research, a simple yet effective method with high performance has been used, which on average, extracts 20 more relevant results than the baseline.


Virtual criterion for generalized Eagon Northcott complexes. Given any map of finitely generated free modules, Buchsbaum and Eisenbud define a family of generalized Eagon Northcott complexes associated to it. We give sufficient criterion for these complexes to be virtual resolutions, thus adding to the known examples of virtual resolutions, particularly those not coming from minimal free resolutions.


A Dynamic Programming Method to Construct Polar Codes with Improved Performance. In the standard polar code construction, the message vector (U 0,U 1, dots,U n 1 ) is divided into information bits and frozen bits according to the reliability of each U i given (U 0,U 1, dots,U i 1 ) and all the channel outputs. While this reliability function is the most suitable measure to choose information bits under the Successive Cancellation (SC) decoder, there is a mismatch between this reliability function and the Successive Cancellation List (SCL) decoder because the SCL decoder also makes use of the information from the future frozen bits. We propose a Dynamic Programming (DP) construction of polar codes to resolve this mismatch. Our DP construction chooses different sets of information bits for different list sizes in order to optimize the performance of the constructed code under the SCL decoder. Simulation results show that our DP polar codes consistently demonstrate 0.3 1 dB improvement over the standard polar codes under the SCL decoder with list size 32 for various choices of code lengths and code rates.


VL LTR Learning Class wise Visual Linguistic Representation for Long Tailed Visual Recognition. Deep learning based models encounter challenges when processing long tailed data in the real world. Existing solutions usually employ some balancing strategies or transfer learning to deal with the class imbalance problem, based on the image modality. In this work, we present a visual linguistic long tailed recognition framework, termed VL LTR, and conduct empirical studies on the benefits of introducing text modality for long tailed recognition (LTR). Compared to existing approaches, the proposed VL LTR has the following merits. (1) Our method can not only learn visual representation from images but also learn corresponding linguistic representation from noisy class level text descriptions collected from the Internet (2) Our method can effectively use the learned visual linguistic representation to improve the visual recognition performance, especially for classes with fewer image samples. We also conduct extensive experiments and set the new state of the art performance on widely used LTR benchmarks. Notably, our method achieves 77.2 overall accuracy on ImageNet LT, which significantly outperforms the previous best method by over 17 points, and is close to the prevailing performance training on the full ImageNet. Code shall be released.


Fuzzy Logic based Logical Query Answering on Knowledge Graph. Answering complex First Order Logical (FOL) queries on large scale incomplete knowledge graphs (KGs) is an important yet challenging task. Recent advances embed logical queries and KG entities in the vector space and conduct query answering via dense similarity search. However, most of the designed logical operators in existing works do not satisfy the axiomatic system of classical logic. Moreover, these logical operators are parameterized so that they require a large number of complex FOL queries as training data, which are often arduous or even inaccessible to collect in most real world KGs. In this paper, we present FuzzQE, a fuzzy logic based query embedding framework for answering FOL queries over KGs. FuzzQE follows fuzzy logic to define logical operators in a principled and learning free manner. Extensive experiments on two benchmark datasets demonstrate that FuzzQE achieves significantly better performance in answering FOL queries compared to the state of the art methods. In addition, FuzzQE trained with only KG link prediction without any complex queries can achieve comparable performance with the systems trained with all FOL queries.


A packaged whispering gallery resonator device based on an optical nanoantenna coupler. In this work, we present the design and fabrication of a packaged whispering gallery mode (WGM) device based on an optical nanoantenna as the coupler and a glass microsphere as the resonator. The microspheres were fabricated from SiO 2 fiber or Er 3 doped fiber, the latter creating a WGM laser with a threshold of 93 mu W at 1531 nm. The coupler resonator WGM device is packaged in a glass capillary. The performance of the packaged microlaser is characterized, with lasing emission both excited in and collected from the WGM cavity via the nanoantenna. The packaged system provides isolation from environmental contamination, a small size, and unidirectional coupling while maintaining a high quality (Q ) factor ( sim 10 8 ). It opens up new possibilities for practical applications of WGM microdevices in a variety of fields such as low threshold lasers, filters, and sensors.


On the design of Monte Carlo particle coagulation solver interface a CPU GPU Super Droplet Method case study with PySDM. Super Droplet Method (SDM) is a probabilistic Monte Carlo type model of particle coagulation process, an alternative to the mean field formulation of Smoluchowski. SDM as an algorithm has linear computational complexity with respect to the state vector length, the state vector length is constant throughout simulation, and most of the algorithm steps are readily parallelizable. This paper discusses the design and implementation of two number crunching backends for SDM implemented in PySDM, a new free and open source Python package for simulating the dynamics of atmospheric aerosol, cloud and rain particles. The two backends share their application programming interface (API) but leverage distinct parallelism paradigms, target different hardware, and are built on top of different lower level routine sets. First offers multi threaded CPU computations and is based on Numba (using Numpy arrays). Second offers GPU computations and is built on top of ThrustRTC and CURandRTC (and does not use Numpy arrays). In the paper, the API is discussed focusing on data dependencies across steps, parallelisation opportunities, CPU and GPU implementation nuances, and algorithm workflow. Example simulations suitable for validating implementations of the API are presented.


Guessing the buffer bound for k synchronizability. A communicating system is k synchronizable if all of the message sequence charts representing the executions can be divided into slices of k sends followed by k receptions. It was previously shown that, for a fixed given k , one could decide whether a communicating system is k synchronizable. This result is interesting because the reachability problem can be solved for k synchronizable systems. However, the decision procedure assumes that the bound k is fixed. In this paper we improve this result and show that it is possible to decide if such a bound k exists.


Fourier Series Expansion Based Filter Parametrization for Equivariant Convolutions. It has been shown that equivariant convolution is very helpful for many types of computer vision tasks. Recently, the 2D filter parametrization technique plays an important role when designing equivariant convolutions. However, the current filter parametrization method still has its evident drawbacks, where the most critical one lies in the accuracy problem of filter representation. Against this issue, in this paper we modify the classical Fourier series expansion for 2D filters, and propose a new set of atomic basis functions for filter parametrization. The proposed filter parametrization method not only finely represents 2D filters with zero error when the filter is not rotated, but also substantially alleviates the fence effect caused quality degradation when the filter is rotated. Accordingly, we construct a new equivariant convolution method based on the proposed filter parametrization method, named F Conv. We prove that the equivariance of the proposed F Conv is exact in the continuous domain, which becomes approximate only after discretization. Extensive experiments show the superiority of the proposed method. Particularly, we adopt rotation equivariant convolution methods to image super resolution task, and F Conv evidently outperforms previous filter parametrization based method in this task, reflecting its intrinsic capability of faithfully preserving rotation symmetries in local image features.


Physically Inspired Dense Fusion Networks for Relighting. Image relighting has emerged as a problem of significant research interest inspired by augmented reality applications. Physics based traditional methods, as well as black box deep learning models, have been developed. The existing deep networks have exploited training to achieve a new state of the art however, they may perform poorly when training is limited or does not represent problem phenomenology, such as the addition or removal of dense shadows. We propose a model which enriches neural networks with physical insight. More precisely, our method generates the relighted image with new illumination settings via two different strategies and subsequently fuses them using a weight map (w). In the first strategy, our model predicts the material reflectance parameters (albedo) and illumination geometry parameters of the scene (shading) for the relit image (we refer to this strategy as intrinsic image decomposition (IID)). The second strategy is solely based on the black box approach, where the model optimizes its weights based on the ground truth images and the loss terms in the training stage and generates the relit output directly (we refer to this strategy as direct). While our proposed method applies to both one to one and any to any relighting problems, for each case we introduce problem specific components that enrich the model performance 1) For one to one relighting we incorporate normal vectors of the surfaces in the scene to adjust gloss and shadows accordingly in the image. 2) For any to any relighting, we propose an additional multiscale block to the architecture to enhance feature extraction. Experimental results on the VIDIT 2020 and the VIDIT 2021 dataset (used in the NTIRE 2021 relighting challenge) reveals that our proposal can outperform many state of the art methods in terms of well known fidelity metrics and perceptual loss.


A construction of maximally recoverable codes. We construct a family of linear maximally recoverable codes with locality r and dimension r 1. For codes of length n with r approx n alpha, 0 le alpha le 1 the code alphabet is of the order n 1 3 alpha , which improves upon the previously known constructions of maximally recoverable codes.


OneFlow Redesign the Distributed Deep Learning Framework from Scratch. Deep learning frameworks such as TensorFlow and PyTorch provide a productive interface for expressing and training a deep neural network (DNN) model on a single device or using data parallelism. Still, they may not be flexible or efficient enough in training emerging large models on distributed devices, which require more sophisticated parallelism beyond data parallelism. Plugins or wrappers have been developed to strengthen these frameworks for model or pipeline parallelism, but they complicate the usage and implementation of distributed deep learning. Aiming at a simple, neat redesign of distributed deep learning frameworks for various parallelism paradigms, we present OneFlow, a novel distributed training framework based on an SBP (split, broadcast and partial value) abstraction and the actor model. SBP enables much easier programming of data parallelism and model parallelism than existing frameworks, and the actor model provides a succinct runtime mechanism to manage the complex dependencies imposed by resource constraints, data movement and computation in distributed deep learning. We demonstrate the general applicability and efficiency of OneFlow for training various large DNN models with case studies and extensive experiments. The results show that OneFlow outperforms many well known customized libraries built on top of the state of the art frameworks. The code of OneFlow is available at https github.com Oneflow Inc oneflow.


ELSD Efficient Line Segment Detector and Descriptor. We present the novel Efficient Line Segment Detector and Descriptor (ELSD) to simultaneously detect line segments and extract their descriptors in an image. Unlike the traditional pipelines that conduct detection and description separately, ELSD utilizes a shared feature extractor for both detection and description, to provide the essential line features to the higher level tasks like SLAM and image matching in real time. First, we design the one stage compact model, and propose to use the mid point, angle and length as the minimal representation of line segment, which also guarantees the center symmetry. The non centerness suppression is proposed to filter out the fragmented line segments caused by lines' intersections. The fine offset prediction is designed to refine the mid point localization. Second, the line descriptor branch is integrated with the detector branch, and the two branches are jointly trained in an end to end manner. In the experiments, the proposed ELSD achieves the state of the art performance on the Wireframe dataset and YorkUrban dataset, in both accuracy and efficiency. The line description ability of ELSD also outperforms the previous works on the line matching task.


A new family of curves in space. This article defines a new family of curves in space, whose graphs generate shapes similar to whirls. An intrinsic equation is found, in terms of curvature and torsion, which gives necessary and sufficient conditions for the existence of this family. Its position vector is found, with arc length parameter and finally a way of generating a great variety of examples is shown in particular an application to rectifying curves is given.