PreferenceNet Encoding Human Preferences in Auction Design with Deep Learning. The design of optimal auctions is a problem of interest in economics, game theory and computer science. Despite decades of effort, strategyproof, revenue maximizing auction designs are still not known outside of restricted settings. However, recent methods using deep learning have shown some success in approximating optimal auctions, recovering several known solutions and outperforming strong baselines when optimal auctions are not known. In addition to maximizing revenue, auction mechanisms may also seek to encourage socially desirable constraints such as allocation fairness or diversity. However, these philosophical notions neither have standardization nor do they have widely accepted formal definitions. In this paper, we propose PreferenceNet, an extension of existing neural network based auction mechanisms to encode constraints using (potentially human provided) exemplars of desirable allocations. In addition, we introduce a new metric to evaluate an auction allocations' adherence to such socially desirable constraints and demonstrate that our proposed method is competitive with current state of the art neural network based auction designs. We validate our approach through human subject research and show that we are able to effectively capture real human preferences. Our code is available at https github.com neeharperi PreferenceNet


SWSR A Chinese Dataset and Lexicon for Online Sexism Detection. Online sexism has become an increasing concern in social media platforms as it has affected the healthy development of the Internet and can have negative effects in society. While research in the sexism detection domain is growing, most of this research focuses on English as the language and on Twitter as the platform. Our objective here is to broaden the scope of this research by considering the Chinese language on Sina Weibo. We propose the first Chinese sexism dataset Sina Weibo Sexism Review (SWSR) dataset , as well as a large Chinese lexicon SexHateLex made of abusive and gender related terms. We introduce our data collection and annotation process, and provide an exploratory analysis of the dataset characteristics to validate its quality and to show how sexism is manifested in Chinese. The SWSR dataset provides labels at different levels of granularity including (i) sexism or non sexism, (ii) sexism category and (iii) target type, which can be exploited, among others, for building computational methods to identify and investigate finer grained gender related abusive language. We conduct experiments for the three sexism classification tasks making use of state of the art machine learning models. Our results show competitive performance, providing a benchmark for sexism detection in the Chinese language, as well as an error analysis highlighting open challenges needing more research in Chinese NLP. The SWSR dataset and SexHateLex lexicon are publicly available.


A C 0 interior penalty method for m th Laplace equation. In this paper, we propose a C 0 interior penalty method for m th Laplace equation on bounded Lipschitz polyhedral domain in mathbb R d , where m and d can be any positive integers. The standard H 1 conforming piecewise r th order polynomial space is used to approximate the exact solution u , where r can be any integer greater than or equal to m . Unlike the interior penalty method in T. Gudi and M. Neilan, em An interior penalty method for a sixth order elliptic equation , IMA J. Numer. Anal., textbf 31(4) (2011), pp. 1734 1753 , we avoid computing D m of numerical solution on each element and high order normal derivatives of numerical solution along mesh interfaces. Therefore our method can be easily implemented. After proving discrete H m norm bounded by the natural energy semi norm associated with our method, we manage to obtain stability and optimal convergence with respect to discrete H m norm. Numerical experiments validate our theoretical estimate.


Input Beam Matching and Beam Dynamics Design Optimization of the IsoDAR RFQ using Statistical and Machine Learning Techniques. We present a novel machine learning based approach to generate fast executing virtual radiofrequency quadrupole (RFQ) particle accelerators using surrogate modelling. These could potentially be used as on line feedback tools during beam commissioning and operation, and to optimize the RFQ beam dynamics design prior to construction. Since surrogate models execute orders of magnitude faster than corresponding physics beam dynamics simulations using standard tools like PARMTEQM and RFQGen, the computational complexity of the multi objective optimization problem reduces significantly. Ultimately, this presents a computationally inexpensive and time efficient method to perform sensitivity studies and an optimization of the crucial RFQ beam output parameters like transmission and emittances. Two different methods of surrogate model creation (polynomial chaos expansion and neural networks) are discussed and the achieved model accuracy is evaluated for different study cases with gradually increasing complexity, ranging from a simple FODO cell example to the full RFQ optimization. We find that variations of the beam input Twiss parameters can be reproduced well. The prediction of the beam with respect to hardware changes, e.g. of the electrode modulation, are challenging on the other hand. We discuss possible reasons.


Absolutely complex balanced kinetic systems. A complex balanced kinetic system is absolutely complex balanced (ACB) if every positive equilibrium is complex balanced. Two results on absolute complex balancing were foundational for modern chemical reaction network theory (CRNT) in 1972, M. Feinberg proved that any deficiency zero complex balanced system is absolutely complex balanced. In the same year, F. Horn and R. Jackson showed that the (full) converse of the result is not true any complex balanced mass action system, regardless of its deficiency, is absolutely complex balanced. In this paper, we present initial results on the extension of the Horn and Jackson ACB Theorem. In particular, we focus on other kinetic systems with positive deficiency where complex balancing implies absolute complex balancing. While doing so, we found out that complex balanced power law reactant determined kinetic systems (PL RDK) systems are not ACB. In our search for necessary and sufficient conditions for complex balanced systems to be absolutely complex balanced, we came across the so called CLP systems (complex balanced systems with a desired "log parametrization" property). It is shown that complex balanced systems with bi LP property are absolutely complex balanced. For non CLP systems, we discuss novel methods for finding sufficient conditions for ACB in kinetic systems containing non CLP systems decompositions, the Positive Function Factor (PFF) and the Coset Intersection Count (CIC) and their application to poly PL and Hill type systems.


Some characterizations of rectifying curves on a smooth surface in Euclidean 3 space. In this paper, we investigate sufficient condition for the invariance of a rectifying curve on a smooth surface immersed in Euclidean 3 space under isometry by using Darboux frame left lbrace T, P, U right rbrace . Further, we find the deviations of the position vector of a rectifying curve on the smooth surface along any tangent vector T a phi u b phi v with respect to the isometry. We also find the deviations of the position vector of a rectifying curve on the smooth surface along the unit normal U to the surface and along P ( U times T) with respect to the isometry.


A survey on product codes and 2 D codes. One of the simplest way of combining codes to form new codes is to take their direct product. Direct product of cyclic codes and various generalizations have been studied for many years. In this note, we survey cyclic product codes, direct product of various generalizations of cyclic codes and their properties.


Knowledge Modelling and Active Learning in Manufacturing. The increasing digitalization of the manufacturing domain requires adequate knowledge modeling to capture relevant information. Ontologies and Knowledge Graphs provide means to model and relate a wide range of concepts, problems, and configurations. Both can be used to generate new knowledge through deductive inference and identify missing knowledge. While digitalization increases the amount of data available, much data is not labeled and cannot be directly used to train supervised machine learning models. Active learning can be used to identify the most informative data instances for which to obtain users' feedback, reduce friction, and maximize knowledge acquisition. By combining semantic technologies and active learning, multiple use cases in the manufacturing domain can be addressed taking advantage of the available knowledge and data.


Constructive basic theory of central simple algebras. We provide a constructive treatment of basic results in the theory of central simple algebras. One main issue is the fact that one starting result, Wedderburn's Theorem stating that a simple algebra is a matrix algebra over a skew field, is not constructively valid. We solve this problem by proving instead a dynamical version of this theorem. One can use this to give constructive proofs of basic results of the theory of central simple algebras, such as Skolem Noether Theorem. We illustrate this development by giving an elementary constructive proof of a theorem of Becher (which is itself a consequence of a celebrated theorem of Merkurjev).


Handwriting Recognition with Novelty. This paper introduces an agent centric approach to handle novelty in the visual recognition domain of handwriting recognition (HWR). An ideal transcription agent would rival or surpass human perception, being able to recognize known and new characters in an image, and detect any stylistic changes that may occur within or across documents. A key confound is the presence of novelty, which has continued to stymie even the best machine learning based algorithms for these tasks. In handwritten documents, novelty can be a change in writer, character attributes, writing attributes, or overall document appearance, among other things. Instead of looking at each aspect independently, we suggest that an integrated agent that can process known characters and novelties simultaneously is a better strategy. This paper formalizes the domain of handwriting recognition with novelty, describes a baseline agent, introduces an evaluation protocol with benchmark data, and provides experimentation to set the state of the art. Results show feasibility for the agent centric approach, but more work is needed to approach human levels of reading ability, giving the HWR community a formal basis to build upon as they solve this challenging problem.


On 3 Lie algebras with a derivation. In this paper, we study 3 Lie algebras with derivations. We call the pair consisting of a 3 Lie algebra and a distinguished derivation by the 3 LieDer pair. We define a cohomology theory for 3 LieDer pair with coefficients in a representation. We study central extensions of a 3 LieDer pair and show that central extensions are classified by the second cohomology of the 3 LieDer pair with coefficients in the trivial representation. We generalize Gerstenhaber's formal deformation theory to 3 LieDer pairs in which we deform both the 3 Lie bracket and the distinguished derivation.


Vive la Diff 'erence!. For a set M , operatorname fin (M) denotes the set of all finite subsets of M , M 2 denotes the Cartesian product M times M , M 2 denotes the set of all 2 element subsets of M , and operatorname seq 1 1 (M) denotes the set of all finite sequences without repetition which can be formed with elements of M . Furthermore, for a set S , let S denote the cardinality of S . Under the assumption that the four cardinalities M 2 , M 2 , operatorname fin (M) , operatorname seq 1 1 (M) are pairwise distinct and pairwise comparable in ZF, there are six possible linear orderings between these four cardinalities. We show that at least five of the six possible linear orderings are consistent with ZF.


Analysis of Machine Learning Approaches to Packing Detection. Packing is an obfuscation technique widely used by malware to hide the content and behavior of a program. Much prior research has explored how to detect whether a program is packed. This research includes a broad variety of approaches such as entropy analysis, syntactic signatures and more recently machine learning classifiers using various features. However, no robust results have indicated which algorithms perform best, or which features are most significant. This is complicated by considering how to evaluate the results since accuracy, cost, generalization capabilities, and other measures are all reasonable. This work explores eleven different machine learning approaches using 119 features to understand which features are most significant for packing detection which algorithms offer the best performance and which algorithms are most economical.


Poisson channel with binary Markov input and average sojourn time constraint. A minimal model for gene expression, consisting of a switchable promoter together with the resulting messenger RNA, is equivalent to a Poisson channel with a binary Markovian input process. Determining its capacity is an optimization problem with respect to two parameters the average sojourn times of the promoter's active (ON) and inactive (OFF) state. An expression for the mutual information is found by solving the associated filtering problem analytically on the level of distributions. For fixed peak power, three bandwidth like constraints are imposed by lower bounding (i) the average sojourn times (ii) the autocorrelation time and (iii) the average time until a transition. OFF favoring optima are found for all three constraints, as commonly encountered for the Poisson channel. In addition, constraint (i) exhibits a region that favors the ON state, and (iii) shows ON favoring local optima.


On Tate Shafarevich groups of one dimensional families of commutative group schemes over number fields. Given a smooth geometrically connected curve C over a field k and a smooth commutative group scheme G of finite type over the function field K of C we study the Tate Shafarevich groups given by elements of H 1(K,G) locally trivial at completions of K associated with closed points of C . When G comes from a k group scheme and k is a number field (or k is a finitely generated field and C has a k point) we prove that the Tate Shafarevich group is finite, generalizing a result of Sa "idi and Tamagawa for abelian varieties. We also give examples of nontrivial Tate Shafarevich groups in the case when G is a torus and prove other related statements.


Optimal Group Formulation Using Machine Learning. Group formation itself a perplexing process. Over the decade of time education and others disciple has improved imminently but optimal group formation in educational system is still struggling. Our research focus on to create optimal group in a class of any institute. In this research we use Simulated Annealing (SA) for best group formation based on the previous academic record. We generally create an arbitrary cluster first then optimise using SA. Our model has significant success rate over a large number of datasets. This research will play a pioneer role in group formations in the academic and related researches.


Weather and Light Level Classification for Autonomous Driving Dataset, Baseline and Active Learning. Autonomous driving is rapidly advancing, and Level 2 functions are becoming a standard feature. One of the foremost outstanding hurdles is to obtain robust visual perception in harsh weather and low light conditions where accuracy degradation is severe. It is critical to have a weather classification model to decrease visual perception confidence during these scenarios. Thus, we have built a new dataset for weather (fog, rain, and snow) classification and light level (bright, moderate, and low) classification. Furthermore, we provide street type (asphalt, grass, and cobblestone) classification, leading to 9 labels. Each image has three labels corresponding to weather, light level, and street type. We recorded the data utilizing an industrial front camera of RCCC (red clear) format with a resolution of 1024 times1084 . We collected 15k video sequences and sampled 60k images. We implement an active learning framework to reduce the dataset's redundancy and find the optimal set of frames for training a model. We distilled the 60k images further to 1.1k images, which will be shared publicly after privacy anonymization. There is no public dataset for weather and light level classification focused on autonomous driving to the best of our knowledge. The baseline ResNet18 network used for weather classification achieves state of the art results in two non automotive weather classification public datasets but significantly lower accuracy on our proposed dataset, demonstrating it is not saturated and needs further research.


A Graph Neural Network Approach for Product Relationship Prediction. Graph Neural Networks have revolutionized many machine learning tasks in recent years, ranging from drug discovery, recommendation systems, image classification, social network analysis to natural language understanding. This paper shows their efficacy in modeling relationships between products and making predictions for unseen product networks. By representing products as nodes and their relationships as edges of a graph, we show how an inductive graph neural network approach, named GraphSAGE, can efficiently learn continuous representations for nodes and edges. These representations also capture product feature information such as price, brand, or engineering attributes. They are combined with a classification model for predicting the existence of the relationship between products. Using a case study of the Chinese car market, we find that our method yields double the prediction performance compared to an Exponential Random Graph Model based method for predicting the co consideration relationship between cars. While a vanilla GraphSAGE requires a partial network to make predictions, we introduce an adjacency prediction model' to circumvent this limitation. This enables us to predict product relationships when no neighborhood information is known. Finally, we demonstrate how a permutation based interpretability analysis can provide insights on how design attributes impact the predictions of relationships between products. This work provides a systematic method to predict the relationships between products in many different markets.


Time for AI (Ethics) Maturity Model Is Now. There appears to be a common agreement that ethical concerns are of high importance when it comes to systems equipped with some sort of Artificial Intelligence (AI). Demands for ethical AI are declared from all directions. As a response, in recent years, public bodies, governments, and universities have rushed in to provide a set of principles to be considered when AI based systems are designed and used. We have learned, however, that high level principles do not turn easily into actionable advice for practitioners. Hence, also companies are publishing their own ethical guidelines to guide their AI development. This paper argues that AI software is still software and needs to be approached from the software development perspective. The software engineering paradigm has introduced maturity model thinking, which provides a roadmap for companies to improve their performance from the selected viewpoints known as the key capabilities. We want to voice out a call for action for the development of a maturity model for AI software. We wish to discuss whether the focus should be on AI ethics or, more broadly, the quality of an AI system, called a maturity model for the development of AI systems.


Verification of the Jacobian Conjecture for d linear maps in two variables. For any integer d geq 1 , we verify the Jacobian Conjecture for a d linear map in two variables. We prove that almost all the coefficients of the formal inverse are in the ideal specified by the Jacobian condition. We find expressions for certain elements in terms of the generators of this ideal. To obtain these expressions, we generalize a bijective proof of the Cayley Hamilton theorem in two ways.


Joint Prediction of Remaining Useful Life and Failure Type of Train Wheelsets A Multi task Learning Approach. The failures of train wheels account for disruptions of train operations and even a large portion of train derailments. Remaining useful life (RUL) of a wheelset measures the how soon the next failure will arrive, and the failure type reveals how severe the failure will be. RUL prediction is a regression task, whereas failure type is a classification task. In this paper, we propose a multi task learning approach to jointly accomplish these two tasks by using a common input space to achieve more desirable results. We develop a convex optimization formulation to integrate both least square loss and the negative maximum likelihood of logistic regression, and model the joint sparsity as the L2 L1 norm of the model parameters to couple feature selection across tasks. The experiment results show that our method outperforms the single task learning method by 3 in prediction accuracy.


Global and Local Texture Randomization for Synthetic to Real Semantic Segmentation. Semantic segmentation is a crucial image understanding task, where each pixel of image is categorized into a corresponding label. Since the pixel wise labeling for ground truth is tedious and labor intensive, in practical applications, many works exploit the synthetic images to train the model for real word image semantic segmentation, i.e., Synthetic to Real Semantic Segmentation (SRSS). However, Deep Convolutional Neural Networks (CNNs) trained on the source synthetic data may not generalize well to the target real world data. In this work, we propose two simple yet effective texture randomization mechanisms, Global Texture Randomization (GTR) and Local Texture Randomization (LTR), for Domain Generalization based SRSS. GTR is proposed to randomize the texture of source images into diverse unreal texture styles. It aims to alleviate the reliance of the network on texture while promoting the learning of the domain invariant cues. In addition, we find the texture difference is not always occurred in entire image and may only appear in some local areas. Therefore, we further propose a LTR mechanism to generate diverse local regions for partially stylizing the source images. Finally, we implement a regularization of Consistency between GTR and LTR (CGL) aiming to harmonize the two proposed mechanisms during training. Extensive experiments on five publicly available datasets (i.e., GTA5, SYNTHIA, Cityscapes, BDDS and Mapillary) with various SRSS settings (i.e., GTA5 SYNTHIA to Cityscapes BDDS Mapillary) demonstrate that the proposed method is superior to the state of the art methods for domain generalization based SRSS.


DensePose 3D Lifting Canonical Surface Maps of Articulated Objects to the Third Dimension. We tackle the problem of monocular 3D reconstruction of articulated objects like humans and animals. We contribute DensePose 3D, a method that can learn such reconstructions in a weakly supervised fashion from 2D image annotations only. This is in stark contrast with previous deformable reconstruction methods that use parametric models such as SMPL pre trained on a large dataset of 3D object scans. Because it does not require 3D scans, DensePose 3D can be used for learning a wide range of articulated categories such as different animal species. The method learns, in an end to end fashion, a soft partition of a given category specific 3D template mesh into rigid parts together with a monocular reconstruction network that predicts the part motions such that they reproject correctly onto 2D DensePose like surface annotations of the object. The decomposition of the object into parts is regularized by expressing part assignments as a combination of the smooth eigenfunctions of the Laplace Beltrami operator. We show significant improvements compared to state of the art non rigid structure from motion baselines on both synthetic and real data on categories of humans and animals.


Regularization based Continual Learning for Fault Prediction in Lithium Ion Batteries. In recent years, the use of lithium ion batteries has greatly expanded into products from many industrial sectors, e.g. cars, power tools or medical devices. An early prediction and robust understanding of battery faults could therefore greatly increase product quality in those fields. While current approaches for data driven fault prediction provide good results on the exact processes they were trained on, they often lack the ability to flexibly adapt to changes, e.g. in operational or environmental parameters. Continual learning promises such flexibility, allowing for an automatic adaption of previously learnt knowledge to new tasks. Therefore, this article discusses different continual learning approaches from the group of regularization strategies, which are implemented, evaluated and compared based on a real battery wear dataset. Online elastic weight consolidation delivers the best results, but, as with all examined approaches, its performance appears to be strongly dependent on task characteristics and task sequence.


SDN based Runtime Security Enforcement Approach for Privacy Preservation of Dynamic Web Service Composition. Aiming at the privacy preservation of dynamic Web service composition, this paper proposes a SDN based runtime security enforcement approach for privacy preservation of dynamic Web service composition. The main idea of this approach is that the owner of service composition leverages the security policy model (SPM) to define the access control relationships that service composition must comply with in the application plane, then SPM model is transformed into the low level security policy model (RSPM) containing the information of SDN data plane, and RSPM model is uploaded into the SDN controller. After uploading, the virtual machine access control algorithm integrated in the SDN controller monitors all of access requests towards service composition at runtime. Only the access requests that meet the definition of RSPM model can be forwarded to the target terminal. Any access requests that do not meet the definition of RSPM model will be automatically blocked by Openflow switches or deleted by SDN controller, Thus, this approach can effectively solve the problems of network layer illegal accesses, identity theft attacks and service leakages when Web service composition is running. In order to verify the feasibility of this approach, this paper implements an experimental system by using POX controller and Mininet virtual network simulator, and evaluates the effectiveness and performance of this approach by using this system. The final experimental results show that the method is completely effective, and the method can always get the correct calculation results in an acceptable time when the scale of RSPM model is gradually increasing.


Approximation of fractional harmonic maps. This paper addresses the approximation of fractional harmonic maps. Besides a unit length constraint, one has to tackle the difficulty of nonlocality. We establish weak compactness results for critical points of the fractional Dirichlet energy on unit length vector fields. We devise and analyze numerical methods for the approximation of various partial differential equations related to fractional harmonic maps. The compactness results imply the convergence of numerical approximations. Numerical examples on spin chain dynamics and point defects are presented to demonstrate the effectiveness of the proposed methods.


Language Agnostic Representation Learning of Source Code from Structure and Context. Source code (Context) and its parsed abstract syntax tree (AST Structure) are two complementary representations of the same computer program. Traditionally, designers of machine learning models have relied predominantly either on Structure or Context. We propose a new model, which jointly learns on Context and Structure of source code. In contrast to previous approaches, our model uses only language agnostic features, i.e., source code and features that can be computed directly from the AST. Besides obtaining state of the art on monolingual code summarization on all five programming languages considered in this work, we propose the first multilingual code summarization model. We show that jointly training on non parallel data from multiple programming languages improves results on all individual languages, where the strongest gains are on low resource languages. Remarkably, multilingual training only from Context does not lead to the same improvements, highlighting the benefits of combining Structure and Context for representation learning on code.


Communication Efficient Split Learning Based on Analog Communication and Over the Air Aggregation. Split learning (SL) has recently gained popularity due to its inherent privacy preserving capabilities and ability to enable collaborative inference for devices with limited computational power. Standard SL algorithms assume an ideal underlying digital communication system and ignore the problem of scarce communication bandwidth. However, for a large number of agents, limited bandwidth resources, and time varying communication channels, the communication bandwidth can become the bottleneck. To address this challenge, in this work, we propose a novel SL framework to solve the remote inference problem that introduces an additional layer at the agent side and constrains the choices of the weights and the biases to ensure over the air aggregation. Hence, the proposed approach maintains constant communication cost with respect to the number of agents enabling remote inference under limited bandwidth. Numerical results show that our proposed algorithm significantly outperforms the digital implementation in terms of communication efficiency, especially as the number of agents grows large.


Brain dynamics via Cumulative Auto Regressive Self Attention. Multivariate dynamical processes can often be intuitively described by a weighted connectivity graph between components representing each individual time series. Even a simple representation of this graph as a Pearson correlation matrix may be informative and predictive as demonstrated in the brain imaging literature. However, there is a consensus expectation that powerful graph neural networks (GNNs) should perform better in similar settings. In this work, we present a model that is considerably shallow than deep GNNs, yet outperforms them in predictive accuracy in a brain imaging application. Our model learns the autoregressive structure of individual time series and estimates directed connectivity graphs between the learned representations via a self attention mechanism in an end to end fashion. The supervised training of the model as a classifier between patients and controls results in a model that generates directed connectivity graphs and highlights the components of the time series that are predictive for each subject. We demonstrate our results on a functional neuroimaging dataset classifying schizophrenia patients and controls.


Gromov Hausdorff class its completeness and cloud geometry. The paper is devoted to the study of the Gromov Hausdorff proper class, consisting of all metric spaces considered up to isometry. In this class, a generalized Gromov Hausdorff pseudometric is introduced and the geometry of the resulting space is investigated. The first main result is a proof of the completeness of the space, i.e., that all fundamental sequences converge in it. Then we partition the space into maximal proper subclasses consisting of spaces at a finite distance from each other. We call such subclasses clouds. A multiplicative similarity group operates on clouds, multiplying all the distances of each metric space by some positive number. We present examples of similarity mappings transferring some clouds into another ones. We also show that if a cloud contains a space that remains at zero distance from itself under action of all similarities, then such a cloud contracted to this space. In the final part, we investigate subsets of the real line with respect to their behavior under various similarities.


Photochemically induced dynamic nuclear polarization of heteronuclear singlet order. Photochemically induced dynamic nuclear polarization (photo CIDNP) is a method to hyperpolarize nuclear spins using light. In most cases, CIDNP experiments are performed at a high magnetic field and the sample is irradiated by the light inside a nuclear magnetic resonance (NMR) spectrometer. Here we demonstrate photo CIDNP hyperpolarization generated in the Earth magnetic field and under zero to ultralow field (ZULF) conditions. Irradiating a sample for several seconds with inexpensive light emitting diodes produces a strong hyperpolarization of 1H and 13C nuclear spins enhancing the NMR signals several hundred times. The hyperpolarized spin states at the Earth field and in ZULF are different. In the latter case, the state corresponds to the singlet order between scalar coupled 1H 13C nuclear spins. This state has a longer lifetime than the state hyperpolarized at Earth field. The method is simple and cost efficient and should be applicable to many molecular systems known to exhibit photo CIDNP, including amino acids and nucleotides.


Electricity intraday price modeling with marked Hawkes processes. We consider a 2 dimensional marked Hawkes process with increasing baseline intensity in order to model prices on electricity intraday markets. This model allows to represent different empirical facts such as increasing market activity, random jump sizes but above all microstructure noise through the signature plot. This last feature is of particular importance for practitioners and has not yet been modeled on those particular markets. We provide analytic formulas for first and second moments and for the signature plot, extending the classic results of Bacry et al. (2013) in the context of Hawkes processes with random jump sizes and time dependent baseline intensity. The tractable model we propose is estimated on German data and seems to fit the data well. We also provide a result about the convergence of the price process to a Brownian motion with increasing volatility at macroscopic scales, highlighting the Samuelson effect.


Mirror Descent Inverse Kinematics for Box constrained Joint Space. This paper proposes a new Jacobian based inverse kinematics (IK) explicitly considering box constrained joint space. To control humanoid robots, the reference pose of end effector(s) is planned in task space, then mapped into the reference joints by IK. Due to the limited analytical solutions for IK, iterative numerical IK solvers based on Jacobian between task and joint spaces have become popular. However, the conventional Jacobian based IK does not explicitly consider the joint constraints, and therefore, they usually clamp the obtained joints during iteration according to the constraints in practice. The problem in clamping operation has been pointed out that it causes numerical instability due to non smoothed objective function. To alleviate the clamping problem, this study explicitly considers the joint constraints, especially the box constraints in this paper, inside the new IK solver. Specifically, instead of clamping, a mirror descent (MD) method with box constrained real joint space and no constrained mirror space is integrated with the conventional Jacobian based IK methods, so called MD IK. In addition, to escape local optima nearly on the boundaries of constraints, a heuristic technique, called epsilon clamping, is implemented as margin in software level. As a result, MD IK achieved more stable and enough fast i) regulation on the random reference poses and ii) tracking to the random trajectories compared to the conventional IK solvers.


Ensuring the Inclusive Use of Natural Language Processing in the Global Response to COVID 19. Natural language processing (NLP) plays a significant role in tools for the COVID 19 pandemic response, from detecting misinformation on social media to helping to provide accurate clinical information or summarizing scientific research. However, the approaches developed thus far have not benefited all populations, regions or languages equally. We discuss ways in which current and future NLP approaches can be made more inclusive by covering low resource languages, including alternative modalities, leveraging out of the box tools and forming meaningful partnerships. We suggest several future directions for researchers interested in maximizing the positive societal impacts of NLP.


Conversational Semantic Role Labeling. Semantic role labeling (SRL) aims to extract the arguments for each predicate in an input sentence. Traditional SRL can fail to analyze dialogues because it only works on every single sentence, while ellipsis and anaphora frequently occur in dialogues. To address this problem, we propose the conversational SRL task, where an argument can be the dialogue participants, a phrase in the dialogue history or the current sentence. As the existing SRL datasets are in the sentence level, we manually annotate semantic roles for 3,000 chit chat dialogues (27,198 sentences) to boost the research in this direction. Experiments show that while traditional SRL systems (even with the help of coreference resolution or rewriting) perform poorly for analyzing dialogues, modeling dialogue histories and participants greatly helps the performance, indicating that adapting SRL to conversations is very promising for universal dialogue understanding. Our initial study by applying CSRL to two mainstream conversational tasks, dialogue response generation and dialogue context rewriting, also confirms the usefulness of CSRL.


A Lower Bound on DNNF Encodings of Pseudo Boolean Constraints. Two major considerations when encoding pseudo Boolean (PB) constraints into SAT are the size of the encoding and its propagation strength, that is, the guarantee that it has a good behaviour under unit propagation. Several encodings with propagation strength guarantees rely upon prior compilation of the constraints into DNNF (decomposable negation normal form), BDD (binary decision diagram), or some other sub variants. However it has been shown that there exist PB constraints whose ordered BDD (OBDD) representations, and thus the inferred CNF encodings, all have exponential size. Since DNNFs are more succinct than OBDDs, preferring encodings via DNNF to avoid size explosion seems a legitimate choice. Yet in this paper, we prove the existence of PB constraints whose DNNFs all require exponential size.


Hourly Warning for Strong Earthquakes. A promising perspective is presented that humans can provide hourly warning for strong land earthquakes (EQs, Ms6). Two important atmospheric electrostatic signal features are described. A table that lists 9 strong land EQs with shock time, epicenter, magnitude, weather in the region near the epicenter, precursor beginning time, and precursor duration demonstrates that at approximately several hours to one day before a strong land EQ, the weather conditions are fair near the epicenter, and an abnormal negative atmospheric electrostatic signal is very obvious. Moreover, the mechanism is explained. A method by which someone could determine the epicenter and the magnitude of a forthcoming strong EQ is suggested. Finally, the possibility of realizing hourly warning for strong land EQs in the near future is pointed out.


Coverage Analysis for Satellite Downlink Networks. Satellite networks are promising to provide ubiquitous and high capacity global wireless connectivity. Traditionally, satellite networks are modeled by placing satellites on a grid of multiple circular orbit geometries. Such a network model, however, requires intricate system level simulations to evaluate coverage performance, and analytical understanding of the satellite network is limited. Continuing the success of stochastic geometry in a tractable analysis for terrestrial networks, in this paper, we develop novel models that are tractable for the coverage analysis of satellite networks using stochastic geometry. By modeling the locations of satellites and users using Poisson point processes on the surfaces of concentric spheres, we characterize analytical expressions for the coverage probability of a typical downlink user as a function of relevant parameters, including path loss exponent, satellite height, density, and Nakagami fading parameter. Then, we also derive a tight lower bound of the coverage probability in closed form expression while keeping full generality. Leveraging the derived expression, we identify the optimal density of satellites in terms of the height and the path loss exponent. Our key finding is that the optimal average number of satellites decreases logarithmically with the network height to maximize the coverage performance. Simulation results verify the exactness of the derived expressions.


Relating Reading, Visualization, and Coding for New Programmers A Neuroimaging Study. Understanding how novices reason about coding at a neurological level has implications for training the next generation of software engineers. In recent years, medical imaging has been increasingly employed to investigate patterns of neural activity associated with coding activity. However, such studies have focused on advanced undergraduates and professionals. In a human study of 31 participants, we use functional near infrared spectroscopy to measure the neural activity associated with introductory programming. In a controlled, contrast based experiment, we relate brain activity when coding to that of reading natural language or mentally rotating objects (a spatial visualization task). Our primary result is that all three tasks coding, prose reading, and mental rotation are mentally distinct for novices. However, while those tasks are neurally distinct, we find more significant differences between prose and coding than between mental rotation and coding. Intriguingly, we generally find more activation in areas of the brain associated with spatial ability and task difficulty for novice coding compared to that reported in studies with more expert developers. Finally, in an exploratory analysis, we also find a neural activation pattern predictive of programming performance 11 weeks later. While preliminary, these findings both expand on previous results (e.g., relating expertise to a similarity between coding and prose reading) and also provide a new understanding of the cognitive processes underlying novice programming.


Electric Vehicle Automatic Charging System Based on Vision force Fusion. Electric vehicles are an emerging means of transportation with environmental friendliness. The automatic charging is a hot topic in this field that is full of challenges. We introduce a complete automatic charging system based on vision force fusion, which includes perception, planning and control for robot manipulations of the system. We design the whole system in simulation and transfer it to the real world. The experimental results prove the effectiveness of our system.


Development of Compact Multivariable Probe for Two Phase Detection in PbLi Argon Columns. Liquid gas two phase flow is a common occurrence in various industrial applications. For nuclear fusion applications with a Li based breeder, existence of two phase flow may lead to critical issues including decreased tritium breeding ratio, generation of hot spots and improper nuclear shielding. Additionally, a very large density ratio of liquid metal to gas mandates relevant experiments towards development and validation of software tools. PbLi has gained immense focus for its various advantages and is utilized in several breeding blanket concepts. In view of above mentioned requirements, a two phase detection tool is imperative for liquid PbLi environment. For liquid metal applications, electrical conductivity based probes are most suitable in terms of ruggedness, fabrication ease and operational simplicity. However, corrosive nature and high operational temperature for PbLi put severe demands on electrical insulation, a foremost requirement for electrical conductivity based schemes. In this study, a multivariable probe based on electrical conductivity and temperature measurement schemes is developed using Al2O3 coating as electrical insulation. Developed probe is validated in PbLi Ar vertical column with bulk PbLi temperature upto 400 degC and time averaged void fraction upto 0.95 covering flow regimes from dispersed bubbly flow upto in box loss of coolant accident. Developed probe provides high reliability and excellent temporal resolution towards individual bubble detection through electrical conductivity based principle alongwith simultaneous two phase temperature trends. Present paper provides details about sensor probe fabrication, calibration, two phase test facility, void fraction estimations, bubble frequency and bubble residence time estimations alongwith critical observations from preliminary experimental investigations.


Sharp Strichartz estimates for some variable coefficient Schr " o dinger operators on mathbb R times mathbb T 2 . In the first part of the paper we continue the study of solutions to Schr "odinger equations with a time singularity in the dispersive relation and in the periodic setting. In the second we show that if the Schr "odinger operator involves a Laplace operator with variable coefficients with a particular dependence on the space variables, then one can prove Strichartz estimates at the same regularity as that needed for constant coefficients. Our work presents a two dimensional analysis, but we expect that with the obvious adjustments similar results are available in higher dimensions.


Ultra clean radon free four cylinder magnetically coupled piston pump. A high performance gas displacement pump based on four individual cylinders was developed. The magnetically coupled pistons and the hermetically sealed housings as well as the special cleanliness in terms of out gassing and radio purity make the four cylinder pump interesting for the usage in low background experiments dealing with noble gases as target. An optimized inner flow path as well as reduced dead volume with respect to the prototype single cylinder pump of the XENON1T experiment combined with advanced polymer piston gaskets and a piston coupling force of (3177 pm 162) N ensures a high and reliable performance. Furthermore, a phase shifted synchronization of the pistons' movement creates an additional performance boost as well as minimizes fluctuations of flow and compression. The pump is able to generate xenon flows of 474 slpm at a pressure difference of 1.80 bar.


Temporal Network Embedding via Tensor Factorization. Representation learning on static graph structured data has shown a significant impact on many real world applications. However, less attention has been paid to the evolving nature of temporal networks, in which the edges are often changing over time. The embeddings of such temporal networks should encode both graph structured information and the temporally evolving pattern. Existing approaches in learning temporally evolving network representations fail to capture the temporal interdependence. In this paper, we propose Toffee, a novel approach for temporal network representation learning based on tensor decomposition. Our method exploits the tensor tensor product operator to encode the cross time information, so that the periodic changes in the evolving networks can be captured. Experimental results demonstrate that Toffee outperforms existing methods on multiple real world temporal networks in generating effective embeddings for the link prediction tasks.


A Model Driven Methodology for Automotive Cybersecurity Test Case Generation. Through international regulations (most prominently the latest UNECE regulation) and standards, the already widely perceived higher need for cybersecurity in automotive systems has been recognized and will mandate higher efforts for cybersecurity engineering. T he UNECE also demands the effectiveness of these engineering to be verified and validated through testing. T his requires both a significantly higher rate and more comprehensiveness of cybersecurity testing that is not effectively to cope with using current, predominantly manual, automotive cybersecurity testing techniques. To allow for comprehensive and efficient testing at all stages of the automotive life cycle, including supply chain parts not at band, and to facilitate efficient third party testing, as well as to test under real world conditions, also methodologies for testing the cybersecurity of vehicular systems as a black box are necessary. T his paper therefore presents a model and attack tree based approach to (semi )automate automotive cybersecurity testing, as well as considerations for automatically black box deriving models for the use in attack modeling.


PyRCN A Toolbox for Exploration and Application of Reservoir Computing Networks. Reservoir Computing Networks belong to a group of machine learning techniques that project the input space non linearly into a high dimensional feature space, where the underlying task can be solved linearly. Popular variants of RCNs, e.g. Extreme Learning Machines (ELMs), Echo State Networks (ESNs) and Liquid State Machines (LSMs) are capable of solving complex tasks equivalently to widely used deep neural networks, but with a substantially simpler training paradigm based on linear regression. In this paper, we introduce the Python toolbox PyRCN (Python Reservoir Computing Networks) for optimizing, training and analyzing Reservoir Computing Networks (RCNs) on arbitrarily large datasets. The tool is based on widely used scientific packages, such as numpy and scipy and complies with the scikit learn interface specification. It provides a platform for educational and exploratory analyses of RCNs, as well as a framework to apply RCNs on complex tasks including sequence processing. With only a small number of basic components, the framework allows the implementation of a vast number of different RCN architectures. We provide extensive code examples on how to set up RCNs for a time series prediction and for a sequence classification task.


Physics Informed Machine Learning of SPH Machine Learning Lagrangian Turbulence. Smoothed particle hydrodynamics (SPH) is a mesh free Lagrangian method for obtaining approximate numerical solutions of the equations of fluid dynamics which has been widely applied to weakly and strongly compressible turbulence in astrophysics and engineering applications. We present a learn able hierarchy of parameterized and "physics explainable" Lagrangian based fluid simulators using both physics based parameters and Neural Networks (NNs) as universal function approximators. This hierarchy of parameterized Lagrangian models gradually introduces more SPH based structure, which we show improves interpretability, generalizability (over larger ranges of time scales and Mach numbers), preservation of physical symmetries (corresponding to conservation of linear and angular momentum), and requires less training data. Our learning algorithm develops a mixed mode approach, mixing forward and reverse mode automatic differentiation with local sensitivity analyses to efficiently perform gradient based optimization. We train this hierarchy on both weakly compressible SPH and DNS data, and show that our physics informed learning method is capable of (a) solving inverse problems over the physically interpretable parameter space, as well as over the space of NN parameters (b) learning Lagrangian statistics of turbulence (interpolation) (c) combining Lagrangian trajectory based, probabilistic, and Eulerian field based loss functions (d) extrapolating beyond training sets into more complex regimes of interest (e) learning new parameterized smoothing kernels better suited to weakly compressible DNS turbulence data.


The wavefront set of spherical Arthur representations. We calculate the wavefront set of spherical Arthur representations of split p adic reductive groups the spherical representations expected to occur as local factors of summands in the discrete automorphic spectrum. We do this by developing new finer invariants for irreducible admissible representations of p adic groups and showing that for spherical Arthur representations they can be computed in terms of equivariant perverse sheaves on the nilpotent cone of the Langlands dual group.


Treewidth of the q Kneser graphs. Let V be an n dimensional vector space over a finite field mathbb F q , where q is a prime power. Define the emph generalized q Kneser graph K q(n,k,t) to be the graph whose vertices are the k dimensional subspaces of V and two vertices F 1 and F 2 are adjacent if dim(F 1 cap F 2) t . Then K q(n,k,1) is the well known q Kneser graph. In this paper, we determine the treewidth of K q(n,k,t) for n geq 2t(k t 1) k 1 and t ge 1 exactly. Note that K q(n,k,k 1) is the complement of the Grassmann graph G q(n,k) . We give a more precise result for the treewidth of overline G q(n,k) for any possible n , k and q .


Symbol Based Convergence Analysis in Block Multigrid Methods with applications for Stokes problems. The main focus of this paper is the study of efficient multigrid methods for large linear system with a particular saddle point structure. In particular, we propose a symbol based convergence analysis for problems that have a hidden block Toeplitz structure. Then, they can be investigated focusing on the properties of the associated generating function mathbf f , which consequently is a matrix valued function with dimension depending on the block of the problem. As numerical tests we focus on the matrix sequence stemming from the finite element approximation of the Stokes equation. We show the efficiency of the methods studying the hidden 9 times 9 block structure of the obtained matrix sequence proposing an efficient algebraic multigrid method with convergence rate independent of the matrix size. Moreover, we present several numerical tests comparing the results with different known strategies.


CLMB deep contrastive learning for robust metagenomic binning. The reconstruction of microbial genomes from large metagenomic datasets is a critical procedure for finding uncultivated microbial populations and defining their microbial functional roles. To achieve that, we need to perform metagenomic binning, clustering the assembled contigs into draft genomes. Despite the existing computational tools, most of them neglect one important property of the metagenomic data, that is, the noise. To further improve the metagenomic binning step and reconstruct better metagenomes, we propose a deep Contrastive Learning framework for Metagenome Binning (CLMB), which can efficiently eliminate the disturbance of noise and produce more stable and robust results. Essentially, instead of denoising the data explicitly, we add simulated noise to the training data and force the deep learning model to produce similar and stable representations for both the noise free data and the distorted data. Consequently, the trained model will be robust to noise and handle it implicitly during usage. CLMB outperforms the previous state of the art binning methods significantly, recovering the most near complete genomes on almost all the benchmarking datasets (up to 17 more reconstructed genomes compared to the second best method). It also improves the performance of bin refinement, reconstructing 8 22 more high quality genomes and 15 32 more middle quality genomes than the second best result. Impressively, in addition to being compatible with the binning refiner, single CLMB even recovers on average 15 more HQ genomes than the refiner of VAMB and Maxbin on the benchmarking datasets. CLMB is open source and available at https github.com zpf0117b CLMB .


Aluminum nitride integration on silicon nitride photonic circuits a new hybrid approach towards on chip nonlinear optics. Aluminum nitride (AlN) is an emerging material for integrated quantum photonics due to its large chi (2) nonlinearity. Here we demonstrate the hybrid integration of AlN on silicon nitride (SiN) photonic chips. Composite microrings are fabricated by reactive DC sputtering of c axis oriented AlN on top of pre patterned SiN. This new approach does not require any patterning of AlN and depends only on reliable SiN nanofabrication. This simplifies the nanofabrication process drastically. Optical characteristics, such as the quality factor, propagation losses and group index, are obtained. Our hybrid resonators can have a one order of magnitude increase in quality factor after the AlN integration, with propagation losses down to SI 0.7 dB cm . Using finite element simulations, phase matching in these waveguides is explored.


On the Generalization of Agricultural Drought Classification from Climate Data. Climate change is expected to increase the likelihood of drought events, with severe implications for food security. Unlike other natural disasters, droughts have a slow onset and depend on various external factors, making drought detection in climate data difficult. In contrast to existing works that rely on simple relative drought indices as ground truth data, we build upon soil moisture index (SMI) obtained from a hydrological model. This index is directly related to insufficiently available water to vegetation. Given ERA5 Land climate input data of six months with land use information from MODIS satellite observation, we compare different models with and without sequential inductive bias in classifying droughts based on SMI. We use PR AUC as the evaluation measure to account for the class imbalance and obtain promising results despite a challenging time based split. We further show in an ablation study that the models retain their predictive capabilities given input data of coarser resolutions, as frequently encountered in climate models.


Co Teaching An Ark to Unsupervised Stereo Matching. Stereo matching is a key component of autonomous driving perception. Recent unsupervised stereo matching approaches have received adequate attention due to their advantage of not requiring disparity ground truth. These approaches, however, perform poorly near occlusions. To overcome this drawback, in this paper, we propose CoT Stereo, a novel unsupervised stereo matching approach. Specifically, we adopt a co teaching framework where two networks interactively teach each other about the occlusions in an unsupervised fashion, which greatly improves the robustness of unsupervised stereo matching. Extensive experiments on the KITTI Stereo benchmarks demonstrate the superior performance of CoT Stereo over all other state of the art unsupervised stereo matching approaches in terms of both accuracy and speed. Our project webpage is https sites.google.com view cot stereo.


PFirewall Semantics Aware Customizable Data Flow Control for Smart Home Privacy Protection. Internet of Things (IoT) platforms enable users to deploy home automation applications. Meanwhile, privacy issues arise as large amounts of sensitive device data flow out to IoT platforms. Most of the data flowing out to a platform actually do not trigger automation actions, while homeowners currently have no control once devices are bound to the platform. We present PFirewall, a customizable data flow control system to enhance the privacy of IoT platform users. PFirewall automatically generates data minimization policies, which only disclose minimum amount of data to fulfill automation. In addition, PFirewall provides interfaces for homeowners to customize individual privacy preferences by defining user specified policies. To enforce these policies, PFirewall transparently intervenes and mediates the communication between IoT devices and the platform, without modifying the platform, IoT devices, or hub. Evaluation results on four real world testbeds show that PFirewall reduces IoT data sent to the platform by 97 without impairing home automation, and effectively mitigates user activity inference tracking attacks and other privacy risks.


The minimal number of homogeneous geodesics depending on the signature of the Killing form. The existence of at least two homogeneous geodesics in any homogeneous Finsler manifold was proved in a previous paper by the author. The examples of solvable Lie groups with invariant Finsler metric which admit just two homogeneous geodesics were presented in another paper. In the present work, it is shown that a homogeneous Finsler manifold with indefinite Killing form admits at least four homogeneous geodesics. Examples of invariant Randers metrics on Lie groups with definite Killing form admitting just two homogeneous geodesics and examples with indefinite Killing form admitting just four homogeneous geodesics are presented.


Local Newton nondegenerate Weil divisors in toric varieties. We introduce and develop the theory of Newton nondegenerate local Weil divisors (X,0) in toric affine varieties. We characterize in terms of the toric combinatorics of the Newton diagram different properties of such singular germs normality, Gorenstein property, or being an Cartier divisor in the ambient space. We discuss certain properties of their (canonical) resolution tilde X to X and the corresponding canonical divisor. We provide combinatorial formulae for the delta invariant delta(X,0) and for the cohomology groups H i( tilde X, mathcal O tilde X ) for i 0 . In the case dim(X,0) 2 , we provide the (canonical) resolution graph from the Newton diagram and we also prove that if such a Weil divisor is normal and Gorenstein, and the link is a rational homology sphere, then the geometric genus is given by the minimal path cohomology, a topological invariant of the link.


Scalable Subspace Methods for Derivative Free Nonlinear Least Squares Optimization. We introduce a general framework for large scale model based derivative free optimization based on iterative minimization within random subspaces. We present a probabilistic worst case complexity analysis for our method, where in particular we prove high probability bounds on the number of iterations before a given optimality is achieved. This framework is specialized to nonlinear least squares problems, with a model based framework based on the Gauss Newton method. This method achieves scalability by constructing local linear interpolation models to approximate the Jacobian, and computes new steps at each iteration in a subspace with user determined dimension. We then describe a practical implementation of this framework, which we call DFBGN. We outline efficient techniques for selecting the interpolation points and search subspace, yielding an implementation that has a low per iteration linear algebra cost (linear in the problem dimension) while also achieving fast objective decrease as measured by evaluations. Extensive numerical results demonstrate that DFBGN has improved scalability, yielding strong performance on large scale nonlinear least squares problems.


ACDNet Adaptively Combined Dilated Convolution for Monocular Panorama Depth Estimation. Depth estimation is a crucial step for 3D reconstruction with panorama images in recent years. Panorama images maintain the complete spatial information but introduce distortion with equirectangular projection. In this paper, we propose an ACDNet based on the adaptively combined dilated convolution to predict the dense depth map for a monocular panoramic image. Specifically, we combine the convolution kernels with different dilations to extend the receptive field in the equirectangular projection. Meanwhile, we introduce an adaptive channel wise fusion module to summarize the feature maps and get diverse attention areas in the receptive field along the channels. Due to the utilization of channel wise attention in constructing the adaptive channel wise fusion module, the network can capture and leverage the cross channel contextual information efficiently. Finally, we conduct depth estimation experiments on three datasets (both virtual and real world) and the experimental results demonstrate that our proposed ACDNet substantially outperforms the current state of the art (SOTA) methods. Our codes and model parameters are accessed in https github.com zcq15 ACDNet.


Metapaths guided Neighbors aggregated Network for?Heterogeneous Graph Reasoning. Most real world datasets are inherently heterogeneous graphs, which involve a diversity of node and relation types. Heterogeneous graph embedding is to learn the structure and semantic information from the graph, and then embed it into the low dimensional node representation. Existing methods usually capture the composite relation of a heterogeneous graph by defining metapath, which represent a semantic of the graph. However, these methods either ignore node attributes, or discard the local and global information of the graph, or only consider one metapath. To address these limitations, we propose a Metapaths guided Neighbors aggregated Heterogeneous Graph Neural Network(MHN) to improve performance. Specially, MHN employs node base embedding to encapsulate node attributes, BFS and DFS neighbors aggregation within a metapath to capture local and global information, and metapaths aggregation to combine different semantics of the heterogeneous graph. We conduct extensive experiments for the proposed MHN on three real world heterogeneous graph datasets, including node classification, link prediction and online A B test on Alibaba mobile application. Results demonstrate that MHN performs better than other state of the art baselines.


Non embeddable II 1 factors resembling the hyperfinite II 1 factor. We consider various statements that characterize the hyperfinite II 1 factors amongst embeddable II 1 factors in the non embeddable situation. In particular, we show that "generically" a II 1 factor has the Jung property (which states that every embedding of itself into its ultrapower is unitarily conjugate to the diagonal embedding) if and only if it is self tracially stable (which says that every such embedding has an approximate lifting). We prove that the enforceable factor, should it exist, has these equivalent properties. Our techniques are model theoretic in nature. We also show how these techniques can be used to give new proofs that the hyperfinite II 1 factor has the aforementioned properties.


Offline Pre trained Multi Agent Decision Transformer One Big Sequence Model Tackles All SMAC Tasks. Offline reinforcement learning leverages previously collected offline datasets to learn optimal policies with no necessity to access the real environment. Such a paradigm is also desirable for multi agent reinforcement learning (MARL) tasks, given the increased interactions among agents and with the enviroment. Yet, in MARL, the paradigm of offline pre training with online fine tuning has not been studied, nor datasets or benchmarks for offline MARL research are available. In this paper, we facilitate the research by providing large scale datasets, and use them to examine the usage of the Decision Transformer in the context of MARL. We investigate the generalisation of MARL offline pre training in the following three aspects 1) between single agents and multiple agents, 2) from offline pretraining to the online fine tuning, and 3) to that of multiple downstream tasks with few shot and zero shot capabilities. We start by introducing the first offline MARL dataset with diverse quality levels based on the StarCraftII environment, and then propose the novel architecture of multi agent decision transformer (MADT) for effective offline learning. MADT leverages transformer's modelling ability of sequence modelling and integrates it seamlessly with both offline and online MARL tasks. A crucial benefit of MADT is that it learns generalizable policies that can transfer between different types of agents under different task scenarios. On StarCraft II offline dataset, MADT outperforms the state of the art offline RL baselines. When applied to online tasks, the pre trained MADT significantly improves sample efficiency, and enjoys strong performance both few short and zero shot cases. To our best knowledge, this is the first work that studies and demonstrates the effectiveness of offline pre trained models in terms of sample efficiency and generalisability enhancements in MARL.


On the prescription of boundary conditions for nonlocal Poisson's and peridynamics models. We introduce a technique to automatically convert local boundary conditions into nonlocal volume constraints for nonlocal Poisson's and peridynamic models. The proposed strategy is based on the approximation of nonlocal Dirichlet or Neumann data with a local solution obtained by using available boundary, local data. The corresponding nonlocal solution converges quadratically to the local solution as the nonlocal horizon vanishes, making the proposed technique asymptotically compatible. The proposed conversion method does not have any geometry or dimensionality constraints and its computational cost is negligible, compared to the numerical solution of the nonlocal equation. The consistency of the method and its quadratic convergence with respect to the horizon is illustrated by several two dimensional numerical experiments conducted by meshfree discretization for both the Poisson's problem and the linear peridynamic solid model.


Tunable Polymer Air Bragg Optical Microcavity Configurations for Controllable Light Matter Interaction Scenarios. Complex optical systems such as high quality microcavities enabled by advanced lithography and processing techniques paved the way to various light matter interactions (LMI) studies. Without lattice matching constraints in epitaxy, coating techniques or shaky open cavity constructions, sub micrometer precise lithographic development of a polymer photoresist paves the way to polymer microcavity structures for various spectral regions based on the material's transparency and the geometrical sizes. We introduce a new approach based on 3D nanowriting in photoresist, which can be employed to achieve microscopic photonic Fabry P 'erot cavity structures with mechanically tunable resonator modes and polymer air Bragg mirrors, directly on a chip or device substrate. We demonstrate by transfer matrix calculations and computer assisted modelling that open microcavities with up to two "air Bragg" reflectors comprising alternating polymer air mirror pair layers enable compression induced mode tuning that can benefit many LMI experiments, such as with 2D materials, nanoparticles and molecules.


Machine Learning Approaches to Learn HyChem Models. The HyChem approach has recently been proposed for modeling high temperature combustion of real, multi component fuels. The approach combines lumped reaction steps for fuel thermal and oxidative pyrolysis with detailed chemistry for the oxidation of the resulting pyrolysis products. However, the approach usually shows substantial discrepancies with experimental data within the Negative Temperature Coefficient (NTC) regime, as the low temperature chemistry is more fuel specific than high temperature chemistry. This paper proposes a machine learning approach to learn the HyChem models that can cover both high temperature and low temperature regimes. Specifically, we develop a HyChem model using the experimental datasets of ignition delay times covering a wide range of temperatures and equivalence ratios. The chemical kinetic model is treated as a neural network model, and we then employ stochastic gradient descent (SGD), a technique that was developed for deep learning, for the training. We demonstrate the approach in learning the HyChem model for F 24, which is a Jet A derived fuel, and compare the results with previous work employing genetic algorithms. The results show that the SGD approach can achieve comparable model performance with genetic algorithms but the computational cost is reduced by 1000 times. In addition, with regularization in SGD, the SGD approach changes the kinetic parameters from their original values much less than genetic algorithm and is thus more likely to retrain mechanistic meanings. Finally, our approach is built upon open source packages and can be applied to the development and optimization of chemical kinetic models for internal combustion engine simulations.


Teaching Humans When To Defer to a Classifier via Exemplars. Expert decision makers are starting to rely on data driven automated agents to assist them with various tasks. For this collaboration to perform properly, the human decision maker must have a mental model of when and when not to rely on the agent. In this work, we aim to ensure that human decision makers learn a valid mental model of the agent's strengths and weaknesses. To accomplish this goal, we propose an exemplar based teaching strategy where humans solve the task with the help of the agent and try to formulate a set of guidelines of when and when not to defer. We present a novel parameterization of the human's mental model of the AI that applies a nearest neighbor rule in local regions surrounding the teaching examples. Using this model, we derive a near optimal strategy for selecting a representative teaching set. We validate the benefits of our teaching strategy on a multi hop question answering task using crowd workers and find that when workers draw the right lessons from the teaching stage, their task performance improves, we furthermore validate our method on a set of synthetic experiments.


TensorLib A Spatial Accelerator Generation Framework for Tensor Algebra. Tensor algebra finds applications in various domains, and these applications, especially when accelerated on spatial hardware accelerators, can deliver high performance and low power. Spatial hardware accelerator exhibits complex design space. Prior approaches based on manual implementation lead to low programming productivity, rendering thorough design space exploration impossible. In this paper, we propose TensorLib, a framework for generating spatial hardware accelerator for tensor algebra applications. TensorLib is motivated by the observation that, different dataflows share common hardware modules, which can be reused across different designs. To build such a framework, TensorLib first uses Space Time Transformation to explore different dataflows, which can compactly represent the hardware dataflow using a simple transformation matrix. Next, we identify the common structures of different dataflows and build parameterized hardware module templates with Chisel. Our generation framework can select the needed hardware modules for each dataflow, connect the modules using a specified interconnection pattern, and automatically generate the complete hardware accelerator design. TensorLib remarkably improves the productivity for the development and optimization of spatial hardware architecture, providing a rich design space with trade offs in performance, area, and power. Experiments show that TensorLib can automatically generate hardware designs with different dataflows and achieve 21 performance improvement on FPGA compared to the state of the arts.


NeSF Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenes. We present NeSF, a method for producing 3D semantic fields from posed RGB images alone. In place of classical 3D representations, our method builds on recent work in implicit neural scene representations wherein 3D structure is captured by point wise functions. We leverage this methodology to recover 3D density fields upon which we then train a 3D semantic segmentation model supervised by posed 2D semantic maps. Despite being trained on 2D signals alone, our method is able to generate 3D consistent semantic maps from novel camera poses and can be queried at arbitrary 3D points. Notably, NeSF is compatible with any method producing a density field, and its accuracy improves as the quality of the density field improves. Our empirical analysis demonstrates comparable quality to competitive 2D and 3D semantic segmentation baselines on complex, realistically rendered synthetic scenes. Our method is the first to offer truly dense 3D scene segmentations requiring only 2D supervision for training, and does not require any semantic input for inference on novel scenes. We encourage the readers to visit the project website.


Versatile, high brightness, cryogenic photoinjector electron source. Since the introduction of the radio frequency (rf) photoinjector electron source over thirty years ago, peak performance demands have dictated the use of high accelerating electric fields. With recent strong advances in obtainable field values, attendant increases in beam brightness are expected to be dramatic. In this article, we examine the implementation of very high gradient acceleration in a high frequency, cryogenic rf photoinjector. We discuss in detail the effects of introducing, through an optimized rf cavity shape, rich spatial harmonic content in the accelerating modes in this device. Higher spatial harmonics give useful, enhanced linear focusing effects, as well as potentially deleterious nonlinear transverse forces. They also serve to strongly increase the ratio of average accelerating field to peak surface field, thus aiding in managing power and dark current related challenges. We investigate two scenarios which are aimed at unique exploitation of the capabilities of this source. First, we investigate the obtaining of extremely high six dimensional brightness for advanced free electron laser applications. We also examine the use of a magnetized photocathode in the device for producing unprecedented low asymmetric emittance, high current electron beams that reach linear collider compatible performance. As both of the scenarios demand an advanced, compact solenoid design, we describe a novel cryogenic solenoid system. With the high field rf and magnetostatic structures introduced, we analyze the collective beam dynamics in these systems through theory and multi particle simulations, including a particular emphasis on granularity effects associated with microscopic Coulomb interactions.


A Class of Nonbinary Symmetric Information Bottleneck Problems. We study two dual settings of information processing. Let mathsf Y rightarrow mathsf X rightarrow mathsf W be a Markov chain with fixed joint probability mass function mathsf P mathsf X mathsf Y and a mutual information constraint on the pair ( mathsf W , mathsf X ) . For the first problem, known as Information Bottleneck, we aim to maximize the mutual information between the random variables mathsf Y and mathsf W , while for the second problem, termed as Privacy Funnel, our goal is to minimize it. In particular, we analyze the scenario for which mathsf X is the input, and mathsf Y is the output of modulo additive noise channel. We provide analytical characterization of the optimal information rates and the achieving distributions.


HySTER A Hybrid Spatio Temporal Event Reasoner. The task of Video Question Answering (VideoQA) consists in answering natural language questions about a video and serves as a proxy to evaluate the performance of a model in scene sequence understanding. Most methods designed for VideoQA up to date are end to end deep learning architectures which struggle at complex temporal and causal reasoning and provide limited transparency in reasoning steps. We present the HySTER a Hybrid Spatio Temporal Event Reasoner to reason over physical events in videos. Our model leverages the strength of deep learning methods to extract information from video frames with the reasoning capabilities and explainability of symbolic artificial intelligence in an answer set programming framework. We define a method based on general temporal, causal and physics rules which can be transferred across tasks. We apply our model to the CLEVRER dataset and demonstrate state of the art results in question answering accuracy. This work sets the foundations for the incorporation of inductive logic programming in the field of VideoQA.


BASAR Black box Attack on Skeletal Action Recognition. Skeletal motion plays a vital role in human activity recognition as either an independent data source or a complement. The robustness of skeleton based activity recognizers has been questioned recently, which shows that they are vulnerable to adversarial attacks when the full knowledge of the recognizer is accessible to the attacker. However, this white box requirement is overly restrictive in most scenarios and the attack is not truly threatening. In this paper, we show that such threats do exist under black box settings too. To this end, we propose the first black box adversarial attack method BASAR. Through BASAR, we show that adversarial attack is not only truly a threat but also can be extremely deceitful, because on manifold adversarial samples are rather common in skeletal motions, in contrast to the common belief that adversarial samples only exist off manifold. Through exhaustive evaluation and comparison, we show that BASAR can deliver successful attacks across models, data, and attack modes. Through harsh perceptual studies, we show that it achieves effective yet imperceptible attacks. By analyzing the attack on different activity recognizers, BASAR helps identify the potential causes of their vulnerability and provides insights on what classifiers are likely to be more robust against attack. Code is available at https github.com realcrane BASAR Black box Attack on Skeletal Action Recognition.


A Critique of Keum Bae Cho's Proof that mathrm P subsetneq mathrm NP . In this paper we critique Keum Bae Cho's proof that mathrm P subsetneq mathrm NP . This proof relates instances of 3 SAT to indistinguishable binomial decision trees and claims that no polynomial time algorithm can solve 3 SAT instances represented by these trees. We argue that their proof fails to justify a crucial step, and so the proof does not establish that mathrm P subsetneq mathrm NP .


Impacts of export restrictions on the global personal protective equipment trade network during COVID 19. The COVID 19 pandemic has caused a dramatic surge in demand for personal protective equipment (PPE) worldwide. Many countries have imposed export restrictions on PPE to ensure the sufficient domestic supply. The surging demand and export restrictions cause shortage contagions on the global PPE trade network. Here, we develop an integrated network model, which integrates a metapopulation model and a threshold model, to investigate the shortage contagion patterns. The metapopulation model captures disease contagion across countries. The threshold model captures the shortage contagion on the global PPE trade network. Results show that, the shortage contagion patterns are mainly decided by top exporters. Export restrictions exacerbate the shortages of PPE and cause the shortage contagion to transmit even faster than the disease contagion. Besides, export restrictions lead to ineffective and inefficient allocation of PPE around the world, which has no benefits for the world to fight against the pandemic.


Towards a Cross Domain Software Safety Assurance Process for Embedded Systems. In this work, we outline a cross domain assurance process for safety relevant software in embedded systems. This process aims to be applied in various different application domains and in conjunction with any development methodology. With this approach we plan to reduce the growing effort for safety assessment in embedded systems by reusing safety analysis techniques and tools for the product development in different domains.


Replaying Archived Twitter When your bird is broken, will it bring you down?. Historians and researchers trust web archives to preserve social media content that no longer exists on the live web. However, what we see on the live web and how it is replayed in the archive are not always the same. In this paper, we document and analyze the problems in archiving Twitter ever since Twitter forced the use of its new UI in June 2020. Most web archives were unable to archive the new UI, resulting in archived Twitter pages displaying Twitter's "Something went wrong" error. The challenges in archiving the new UI forced web archives to continue using the old UI. To analyze the potential loss of information in web archival data due to this change, we used the personal Twitter account of the 45th President of the United States, realDonaldTrump, which was suspended by Twitter on January 8, 2021. Trump's account was heavily labeled by Twitter for spreading misinformation, however we discovered that there is no evidence in web archives to prove that some of his tweets ever had a label assigned to them. We also studied the possibility of temporal violations in archived versions of the new UI, which may result in the replay of pages that never existed on the live web. Our goal is to educate researchers who may use web archives and caution them when drawing conclusions based on archived Twitter pages.


A review on deep reinforcement learning for fluid mechanics an update. In the past couple of years, the interest of the fluid mechanics community for deep reinforcement learning (DRL) techniques has increased at fast pace, leading to a growing bibliography on the topic. While the capabilities of DRL to solve complex decision making problems make it a valuable tool for active flow control, recent publications also demonstrated applications to other fields, such as shape optimization or microfluidics. The present work aims at proposing an exhaustive review of the existing literature, and is a follow up to our previous review on the topic. The contributions are regrouped by field of application, and are compared together regarding algorithmic and technical choices, such as state selection, reward design, time granularity, and more. Based on these comparisons, general conclusions are drawn regarding the current state of the art in the domain, and perspectives for future improvements are sketched.


Every time I fire a conversational designer, the performance of the dialog system goes down. Incorporating explicit domain knowledge into neural based task oriented dialogue systems is an effective way to reduce the need of large sets of annotated dialogues. In this paper, we investigate how the use of explicit domain knowledge of conversational designers affects the performance of neural based dialogue systems. To support this investigation, we propose the Conversational Logic Injection in Neural Network system (CLINN) where explicit knowledge is coded in semi logical rules. By using CLINN, we evaluated semi logical rules produced by a team of differently skilled conversational designers. We experimented with the Restaurant topic of the MultiWOZ dataset. Results show that external knowledge is extremely important for reducing the need of annotated examples for conversational systems. In fact, rules from conversational designers used in CLINN significantly outperform a state of the art neural based dialogue system.


Decentralized Online Learning for Noncooperative Games in Dynamic Environments. Decentralized online learning for seeking generalized Nash equilibrium (GNE) of noncooperative games in dynamic environments is studied in this paper. Each player aims at selfishly minimizing its own time varying cost function subject to time varying coupled constraints and local feasible set constraints. Only local cost functions and local constraints are available to individual players, who can receive their neighbors' information through a fixed and connected graph. In addition, players have no prior knowledge of cost functions and local constraint functions in the future time. In this setting, a novel distributed online learning algorithm for seeking GNE of the studied game is devised based on mirror descent and a primal dual strategy. It is shown that the presented algorithm can achieve sublinearly bounded dynamic regrets and constraint violation by appropriately choosing decreasing stepsizes. Finally, the obtained theoretical result is corroborated by a numerical simulation.


Multimode piezoelectric shunt damping of thin plates with arrays of separately shunted patches, method, and experimental validation. Two dimensional thin plates are widely used in many applications. Shunt damping is a promising way for the attenuation of vibration of these electromechanical systems. It enables a compact vibration damping method without adding significant mass and volumetric occupancy. Analyzing the dynamics of such electromechanical systems requires precise modeling tools that properly consider the coupling between the piezoelectric elements and the host structure. Although the concept of shunt damping has been studied extensively in the literature, most of the studies do not provide a formulation for modeling the multiple piezoelectric patches that are scattered on the host structure and shunted separately. This paper presents a methodology and a formulation for separately shunted piezoelectric patches for achieving higher performance on vibration attenuation. The Rayleigh Ritz method is used for performing modal analysis and obtaining the frequency response functions of the electro mechanical system. The developed model includes mass and stiffness contribution of the piezoelectric patches as well as the electromechanical coupling effect. In this study, the piezoelectric patches are shunted via separate electrical circuits and compared with the ones those are shunted via interconnected electrical circuits. For verification, system level finite element simulations are performed in ANSYS software and compared with the analytical model results. An experimental setup is also built to validate the performance of the separately shunted piezoelectric patches. The effectiveness of the method is investigated for a broader range of frequencies and it was shown that separately shunted piezoelectric patches are more effective compared to connected for a wide range of frequencies.


Every finite graph arises as the singular set of a compact 3 d calibrated area minimizing surface. Given any (not necessarily connected) finite graph in the combinatorial sense, we construct calibrated 3 dimensional homologically area minimizing oriented surface on a 7 dimensional closed compact Riemannian manifold, so that the singular set of the surface consists of precisely this finite graph. The constructions are based on some unpublished ideas of Professor Camillo De Lellis and Professor Robert Bryant.


A nonlinear diffusion method for semi supervised learning on hypergraphs. Hypergraphs are a common model for multiway relationships in data, and hypergraph semi supervised learning is the problem of assigning labels to all nodes in a hypergraph, given labels on just a few nodes. Diffusions and label spreading are classical techniques for semi supervised learning in the graph setting, and there are some standard ways to extend them to hypergraphs. However, these methods are linear models, and do not offer an obvious way of incorporating node features for making predictions. Here, we develop a nonlinear diffusion process on hypergraphs that spreads both features and labels following the hypergraph structure, which can be interpreted as a hypergraph equilibrium network. Even though the process is nonlinear, we show global convergence to a unique limiting point for a broad class of nonlinearities, which is the global optimum of a interpretable, regularized semi supervised learning loss function. The limiting point serves as a node embedding from which we make predictions with a linear model. Our approach is much more accurate than several hypergraph neural networks, and also takes less time to train.


Qanaat A Scalable Multi Enterprise Permissioned Blockchain System with Confidentiality Guarantees. Today's large scale data management systems need to address distributed applications' confidentiality and scalability requirements among a set of collaborative enterprises. In this paper, we present Qanaat, a scalable multi enterprise permissioned blockchain system that guarantees confidentiality. Qanaat consists of multiple enterprises where each enterprise partitions its data into multiple shards and replicates a data shard on a cluster of nodes to provide fault tolerance. Qanaat presents data collections that preserve the confidentiality of transactions and a transaction ordering schema that enforces only the necessary and sufficient constraints to guarantee data consistency. Furthermore, Qanaat supports both data consistency and confidentiality across collaboration workflows where an enterprise can participate in different collaboration workflows with different sets of enterprises. Finally, Qanaat presents a suite of centralized and decentralized consensus protocols to support different types of intra shard and cross shard transactions within or across enterprises. The experimental results reveal the efficiency of Qanaat in processing multi shard and multi enterprise transactions.


Physics informed Convolutional Neural Networks for Temperature Field Prediction of Heat Source Layout without Labeled Data. Recently, surrogate models based on deep learning have attracted much attention for engineering analysis and optimization. As the construction of data pairs in most engineering problems is time consuming, data acquisition is becoming the predictive capability bottleneck of most deep surrogate models, which also exists in surrogate for thermal analysis and design. To address this issue, this paper develops a physics informed convolutional neural network (CNN) for the thermal simulation surrogate. The network can learn a mapping from heat source layout to the steady state temperature field without labeled data, which equals solving an entire family of partial difference equations (PDEs). To realize the physics guided training without labeled data, we employ the heat conduction equation and finite difference method to construct the loss function. Since the solution is sensitive to boundary conditions, we properly impose hard constraints by padding in the Dirichlet and Neumann boundary conditions. In addition, the neural network architecture is well designed to improve the prediction precision of the problem at hand, and pixel level online hard example mining is introduced to overcome the imbalance of optimization difficulty in the computation domain. The experiments demonstrate that the proposed method can provide comparable predictions with numerical method and data driven deep learning models. We also conduct various ablation studies to investigate the effectiveness of the network component and training methods proposed in this paper.


A simple numerical method for Hele Shaw type problems by the method of fundamental solutions. Hele Shaw flows with time dependent gaps create fingering patterns, and magnetic fluids in Hele Shaw cells create intriguing patterns.We propose a simple numerical method for Hele Shaw type problems by the method of fundamental solutions.The method of fundamental solutions is one of the mesh free numerical solvers for potential problems, which provides a highly accurate approximate solution despite its simplicity.Moreover, combining with the asymptotic uniform distribution method, the numerical method satisfies the volume preserving property.We use Amano's method to arrange the singular points in the method of fundamental solutions.We show several numerical results to exemplify the effectiveness of our numerical scheme.


Autoregressive Belief Propagation for Decoding Block Codes. We revisit recent methods that employ graph neural networks for decoding error correcting codes and employ messages that are computed in an autoregressive manner. The outgoing messages of the variable nodes are conditioned not only on the incoming messages, but also on an estimation of the SNR and on the inferred codeword and on two downstream computations (i) an extended vector of parity check outcomes, (ii) the mismatch between the inferred codeword and the re encoding of the information bits of this codeword. Unlike most learned methods in the field, our method violates the symmetry conditions that enable the other methods to train exclusively with the zero word. Despite not having the luxury of training on a single word, and the inability to train on more than a small fraction of the relevant sample space, we demonstrate effective training. The new method obtains a bit error rate that outperforms the latest methods by a sizable margin.


Towards High Fidelity Face Relighting with Realistic Shadows. Existing face relighting methods often struggle with two problems maintaining the local facial details of the subject and accurately removing and synthesizing shadows in the relit image, especially hard shadows. We propose a novel deep face relighting method that addresses both problems. Our method learns to predict the ratio (quotient) image between a source image and the target image with the desired lighting, allowing us to relight the image while maintaining the local facial details. During training, our model also learns to accurately modify shadows by using estimated shadow masks to emphasize on the high contrast shadow borders. Furthermore, we introduce a method to use the shadow mask to estimate the ambient light intensity in an image, and are thus able to leverage multiple datasets during training with different global lighting intensities. With quantitative and qualitative evaluations on the Multi PIE and FFHQ datasets, we demonstrate that our proposed method faithfully maintains the local facial details of the subject and can accurately handle hard shadows while achieving state of the art face relighting performance.


The almost disjointness invariant for products of ideals. The almost disjointness numbers associated to the quotients determined by the transfinite products of the ideal of finite sets are investigated. A mathrm ZFC lower bound involving the minimum of the classical almost disjointness and splitting numbers is proved for these characteristics. En route, it is shown that the splitting numbers associated to these quotients are all equal to the classical splitting number. Finally, it is proved to be consistent that the almost disjointness numbers associated to these quotients are all equal to the second uncountable cardinal while the bounding number is the first uncountable cardinal. Several open problems are considered.